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Chapter  1 

Introduction 


In  this  report,  we  address  the  general  problem  of  designing  controllers  that  minimize  the 
maximum  peak-to-peak  gain,  otherwise  known  as  the  l\  optimal  control  problem,  in  the 
presence  of  structured  uncertainty.  Four  different  problems  are  discussed: 

1.  Controller  design  in  the  presence  of  structured  uncertainty  with  a  general  discussion 
on  the  synthesis  of  (i  optimal  controllers. 

2.  The  State-feedback  problem. 

3.  The  advantages  of  nonlinear  controllers  in  minimizing  the  foo  induced  norm. 

4.  Peak-to-Peak  performance  for  slowly  varying  systems. 

These  problems  are  addressed  in  the  following  four  chapters.  Chapter  1  is  taken 
from  the  paper  written  by  Dahleh  an<l  Kbammsh  [8],  Chapter  2  is  taken  from  the  paper 
written  by  Diaz-Bobillo  and  Dahleh  (2.3],  Chapter  3  is  taken  from  the  paper  written 
by  Dahleh  and  Shamma  [14]  and  finally  Chapter  4  is  taken  from  the  paper  written  by 
Voulgaris,  Dahleh  and  Valavani  [59] . 
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Chapter  2 

Robust  Controller  Design  in  the 
presence  of  Structured 
Uncertainty 


This  chapter  addresses  the  problem  of  designing  feedback  controUers  to  achieve  good 
performance  in  the  presence  of  structured  plant  uncertainty  and  bounded  but  tmknown 
disturbances.  A  general  formulation  for  the  performance  robustness  problem  is  presented 
and  exact  computable  conditions  are  furnished.  These  conditions  are  then  utilized  for 
synthesizing  robust  controllers  which  involves  solving  optimization  problems.  These 
solutions  are  computed  using  the  dtiality  theory  of  Lagrange  multipliers.  Approximations 
and  computational  issues  are  discussed. 

2.1  Introduction 

The  objective  of  Robust  Control  is  to  provide  in  a  quantitative  way  the  fundaimental 
limitations  and  capabilities  of  controller  design  in  order  to  achieve  good  performance 
requirements  in  the  presence  of  uncertainty.  Even  though  a  real  system  is  not  imcertain, 
it  is  desirable  to  think  of  it  as  such  to  reflect  our  imprecise  or  partial  knowledge  of  its 
dyneimics.  On  the  other  hand,  uncertainty  in  the  noise  and  disturbances  can  be  cast 
under  “real  tmcertainties,”  as  it  is  practically  impossible  to  provide  exact  models  for 
such  inputs. 

Many  of  the  design  specifications  tend  to  be  concerned  with  amplitudes  of  signals.  For 
instance,  tracking,  disturbance  rejection,  actuator  authority,  all  result  in  specifications 
concerning  the  maximum  amplitudes  of  signals.  On  the  other  hand,  disturbances  and 
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noise  are  usueJly  persistent,  bounded,  otherwise  unknown.  This  environment  motivates 
a  Peak-to-Peak  kind  of  specifications,  which  is  the  theme  of  the  ti  theory. 

In  this  chapter,  a  general  framework  for  designing  controllers  that  achieve  robust 
Peak-to-Peak  performance  in  the  presence  of  plant  perturbations  is  presented.  First, 
computable  necessary  and  sufficient  conditions  for  performance  robustness  are  presented. 
The  connections  between  these  conditions  and  spectral  properties  of  positive  matrices 
are  highlighted  and  utilized  to  simplify  the  computations.  These  conditions  are  in  turn 
used  for  the  synthesis  problem  which  will  involve  iterative  solutions  of  minimization 
problems,  the  solution  of  which  is  obtained  by  using  the  duality  theory  of  Lagrange 
multipliers. 

The  problem,  formulated  in  [58],  was  solved  in  [10,  11).  The  theory  was  further 
developed  in  [17,  23,  24,  45,  54,  55).  The  robust  stabilization  problem  in  the  presence 
of  ^oo-stable  perturbations  was  first  analyzed  in  [9]  in'  the  case  of  unstructured  pertur¬ 
bations.  In  [32],  a  performance  objective  was  added  to  the  robust  stability  requirement 
in  the  unstructured  perturbations  case  and  conditions  were  provided  for  robust  per¬ 
formance  and  stability.  This  led  the  way  to  the  development  of  exact  necessary  and 
sufficient  conditions  for  robust  performance  in  the  presence  of  structured  perturbations 
[33,  34,  35).  Most  of  the  above  restdts  have  continuous-time  analogs. 

There  are  a  number  of  contributions  in  this  chapter.  On  one  hand,  it  presents  a  imi- 
fied  framework  for  designing  robust  controllers  in  the  presence  of  structured  imcertainty. 
Non-conservative  conditions  to  guarantee  robtist  performance  are  developed  directly  in 
terms  of  the  spectral  radius  of  certain  matrices  capturing  the  structure  of  the  perturba¬ 
tions.  Exact  relations  between  these  conditions  and  linear  matrix  inequality  conditions 
are  then  established.  On  the  other  hand,  the  use  of  linear  programming  in  synthesiz¬ 
ing  robust  controllers  is  highlighted  through  the  application  of  the  theory  of  Lagrange 
multipliers.  Through  this  simple  formulation,  problems  that  admit  a  finite- dimensional 
equivalence  become  quite  transparent.  For  the  rest  of  the  problems,  the  theory  proves  to 
be  quite  instrumental  in  providing  upper  and  lower  approximations  of  the  exact  problem. 

This  chapter  puts  together  all  of  the  above  development  in  a  way  that  makes  the 
theory  readily  usable  for  design.  In  general,  det.nils  that  appeared  elsewhere  will  not  be 
presented,  however,  simple  and  intuitive  proofs  of  the  main  ideas  will  be.  Similarities 
and  contrasts  between  this  theory  and  the  ft  formalism  will  also  be  highlighted. 
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2.2  Preliminaries 


First,  some  notation  regarding  standard  concepts  for  input/output  systems.  For  more 
details,  consult  [18,  60]  and  references  therein. 

•  /oo  denotes  the  set  of  all  sequences  /  =  {/o,  fi,  h,  •  •  •},  fk  €  IR^,  so  that 

11/11/  =  sup|/(l:)|oo  <  oo, 

■*>  k 

where  |/(A:)|oo  is  the  standard  norm  on  vectors.  Also,  /qo,*  denotes  the  extended 
space  of  all  sequences  in  IR/^  and  foo,e\foo  denotes  the  set  difference. 

•  denotes  the  set  of  all  sequences  so  that 

ll/IU,  -  {ei/(^)Ip) 

•  Co  denotes  the  subspace  of  /go  of  sequences  converging  to  zero. 

•  5  denotes  the  backward  shift  operator  (unit  time  delay). 

•  Pk  denotes  the  A;"’ -truncation  operator  on  frx,,t‘ 

F*:  {/o,  /i.  /2 - [  — *  {/o?  •  •  •»  /jlr»  0, . . .} 

•  A  nonlinear  operator  H  :  ^  ‘  f  's  ran-iaf  if 

PkU  VI-  T  0,1,2,..., 

strictly  causal  if 

Pfc/f  -  VI  -  0.1,2,..., 

time-invariant  if  it  commutes  with  the  shift  operator  {H S  =  5ff),  and  (p  stable  if 

mrff\K  , 

\\H\\  Slip  sup  —  ■  <  00. 

The  quantity  ||P||  is  called  the  inducrd  operator  norm  over  Ip. 


4 


•  Ctv  denotes  the  set  of  all  linear  causal  foo-stable  operators.  This  space  is  charac¬ 
terized  by  infinite  block  lower  triangular  matrices  of  the  form 

(Ifoo  0 

H\o 

\ 

where  Hij  is  a  p  x  q  »uatrix.  This  infinite  matrix  representation  of  H  acts  on 
elements  of  by  multiplication,  i.e.,  if  u  G  then  y  :=  Hu  £  where 

y{^)  =  Y!j=o  f^irju(j)  £  R'*.  The  induced  1  urin  of  such  an  operator  is  given  by: 

=sup|(7/.i...^,.)|i 

t 

where  |4|i  =  max^  |a.ji- 

•  Cti  denotes  the  set  c  all  f/  6  Ctv  which  are  time-invariant.  It  is  well  known 
that  Cti  is  isomorphic  to  t\  and  the  matrix  representation  of  the  operator  has  a 
Toeplitz  structure.  Every  element  in  Cti  is  associated  with  a  A-transform  defined 
as 

OO 

//(A)  -  Vff(I•)A^ 

*•--0 

The  collection  of  all  such  transforms  is  usually  denoted  by  A,  which  will  be 
equipped  with  the  same  norm  as  the  norm. 

Througnout  this  chapter,  systems  are  thought  of  as  operators.  So  the  composition 
of  two  operators  6',  H  is  denoted  as  GH.  If  both  ar  time-invariant  then  GH  £  G  (or 
Cti),  and  the  induced  norm  is  denoted  by  ||(r'//||i.  When  the  A-transform  is  referred 
to  specifically,  we  use  the  notation  H  for  ^he  transform  of  H .  Also,  all  operator  spaces 
are  matrix-valued  functions  whose  dimensions  will  be  suppressed  in  general  whenever 
understood  from  the  context. 

Let  X  be  a  normed  linear  space.  The  space  of  all  bou  ’ded  linear  functionals  on 
X  is  denoted  X*,  equipped  with  the  natural  iinlnced  norm;  X*  is  always  complete. 
It  is  convenient  to  put  on  A'*  a  weaker  topology  which  makes  A'**  =  A'.  This  is  the 
u7eafc*-topology. 

Dual  of  fp,  1  <  p  ^  oo:  The  dual  of  f,,  is  f,,  where  i  +  i  -  1.  The  characterization  is 
given  by  the  following  theorem. 


Theorem  2.2.1  Every  bounded  linear  functional  f  on  tp,l  <  p  <  oo,  is  representable 
uniquely  in  the  form 

/(*)  = 

i=0 

where  y  =  (yj)  is  an  element  in  Furthermore,  every  element  of  tq  defines  a  member 
of  Ip  in  this  way  and 

ll/ll  =  lly||. 

The  above  definitions  are  extended  for  vector-valued  sequences  and  matrix- valued  se¬ 
quences  in  the  obvious  way. 

In  this  chapter,  we  will  give  a  solution  to  the  /i  synthesis  problem  by  using  the 
theory  of  Lagrange  multipliers.  Many  people  are  quite  familiar  with  this  theory  for 
finite-dimensional  optimization  problems,  and  in  the  sequel,  we  will  review  the  basic 
duality  theorem  for  infinite-dimensional  problems.  For  a  more  thorough  treatment,  see 
[43]. 

Let  X  be  a  vector  space.  A  convex  cone  P  is  a  convex  set  such  that  if  r  6  P  then 
ax  £  P  for  all  real  a  >  0.  Given  such  P,  it  is  possible  to  define  an  ordering  relation  on 
X  as  follows:  a;  >  y  if  and  only  if  r  -  y  G  P.  Then  it  is  natural  to  define  a  dual  cone  P* 
(with  an  abuse  of  notation)  inside  X*  in  the  following  way: 

P*  {r*  f  A'*|  <  r,r*  >>  0  Var  e  P}. 

This  in  turn  defines  an  ordering  relation  on  A'*. 

Let  /  be  a  convex  function  from  A'  to  IR  and  G  a  convex  map  from  X  to  another 
normed  space  Z.  Also,  let  fi  be  a  convex  subset  of  A'.  Assmiie  that  there  exists  a:i  G 
such  that  G{x\)  <  0  (the  inequality  with  respect  to  some  cone  in  Z).  This  is  generally 
known  as  the  regularity  assumption.  Define  the  minimization  problem: 

Po  =  inf  f(x)  .subject  t«)  x  G  D,  6’(a‘)  <  0. 

The  Lagrange  multiplier  theory  basically  says  that  this  constraint  optimization  problem 
can  be  transformed  o  an  unconstrained  problem  over  r  G  fl.  Precisely,  there  exists  an 
element  zj  >  0  in  Z*  ^  vith  respect  to  the  dtial  cone),  so  that 

fi„  inr{/(x)|  <  r;(x),;n  >} 


r. 


The  element  Zq  is  precisely  the  Lagrange  multiplier.  Equivalently, 

/<o  =  sup  inf{/(r)+  <  G(x),z*  >}. 

**>o*en 

In  the  case  where  the  infimization  problem  contains  equality  constraints,  we  will  replace 
them  by  two  inequality  constraints.  Care  should  be  taken  in  this  case  since  the  assump¬ 
tion  that  the  constraint  set  has  an  interior  point  will  be  violated;  however  under  mild 
assumptions,  if  the  equality  constraints  are  given  in  terms  of  linear  operators,  the  result 
will  still  hold  without  the  regularity  conditions. 

2.3  Why  the  ioo  signal  norm? 

In  many  real-world  applications,  output  disturbance  and/or  noise  is  persistent,  i.e.,  con¬ 
tinues  acting  on  the  system  as  long  as  the  system  is  in  operation.  This  implies  that 
such  inputs  have  infinite  energy,  and  thus  one  cannot  model  them  as  “bounded-energy 
signals.”  Nevertheless,  one  can  get  a  good  estimate  on  the  maximum  amplitude  of  such 
inputs.  Examples  where  bounded  disturbances  arise  in  practical  situations  are  abun¬ 
dant.  Wind  gusts  facing  an  aircraft  in  flight  can  be  viewed  as  bounded  disturbances. 
Without  a  correcting  control  action,  such  disturbances  will  cause  the  aircraft  to  deviate 
from  its  set  path.  An  automobile  driven  over  an  impaved  road  experiences  disturbances 
due  to  the  irregularity  of  the  course.  Stich  disturbances,  although  persistent,  are  clearly 
bounded  in  magnitude.  In  process  control,  level  measurements  of  a  boiling  liquid  are 
corrupted  by  bounded  disturbances  due  to  the  constant  level  fluctuations  of  the  liquid. 
Because  such  disturbances  are  so  frequent,  a  mathematical  model  describing  them  is 
essential.  The  norm  is  clearly  the  most  natural  choice  for  measuring  the  size  of  such 
disturbances.  In  general,  we  will  assume  that  the  disturbance  is  the  output  of  a  linear 
time-invariant  (LTI)  filter  subjected  to  signals  of  magnitude  less  than  or  equal  to  one, 
i.e., 

d  -  II'tc,  IIh’IIoo  5  1 . 

Not  only  is  the  norm  useful  for  measuring  input  signal  size,  but  it  can  also  be  very 
useful  as  a  measure  for  the  size,  of  output  signals.  For  example,  in  many  applications  it 
is  crucial  that  the  tracking  error  never  exceeds  a  certain  level  at  any  time.  While  this 
requirement  cannot  be  captured  by  using  the  /’2  norm,  it  ran  be  stated  explicitly  as  a 
condition  on  the  (go  norm  of  the  error  signal.  Another  situation  when  the  norm  is 


I 


useful  is  when  the  plant,  or  einy  other  device  in  the  control  loop,  has  a  maximmn  input 
rating  which  should  not  be  exceeded.  This  translates  directly  to  a  requirement  on  the 
foo  norm  of  that  input.  An  example  of  such  a  requirement  appears  in  the  next  section. 
In  addition,  the  foo  norm  plays  an  important  role  in  designing  controllers  for  nonlinear 
systems.  Since  most  of  the  nonlinear  controller  designs  are  based  on  linearization,  the 
linear  model  gives  a  faithful  representation  of  the  system  only  if  the  states  remain  close 
to  the  equilibrium  point,  a  requirement  captured  directly  in  terms  of  the  fgo  norm. 

2.4  The  £i  Norm 

While  the  loo  norm  is  used  as  a  measure  of  signal  size,  the  li  norm  is  used  to  measure 
a  system’s  amplification  of  too  input  signals.  Let  T  be  an  LTI  system  given  by 

z(t)  =  (7’«0(f)= 

k-o 

The  inputs  and  outputs  of  the  system  are  measured  by  their  maximum  amplitude  over 
all  time,  otherwise  known  as  the  loo  norm,  i.e., 

||u»||..e.  maxsup  |u>j(A-)|. 

J  k 

The  li  norm  of  the  system  T  is  precisely  equal  to  the  maximum  amplification  the  system 
exerts  on  bounded  inputs.  This  measure  defined  on  the  system  T  is  known  as  the  induced 
operator  norm  and  is  mathematically  defined  as 

||T||-  sup  II7VIU-:  ilTlli, 

where  Ill’ll^  is  the  fi-norm  of  the  pulse  response  and  is  given  by 

||T||,  --  max^^  |Lj(^)l- 
j  k 

A  system  is  said  to  be  loo-  stable  if  it  has  a  bounded  (i  norm,  and  the  space  of  all 
such  systems  will  be  denoted  by  fj.  From  this  definition,  it  is  clear  that  the  system 
attenuates  inputs  if  its  ti  norm  is  strictly  less  than  tinity. 

In  the  case  where  the  inputs  and  outputs  of  the  linear  system  are  measured  by  the  ^2 
norm,  then  the  gain  of  the  system  is  giv*'n  by  the  ffoo  norm  and  is  given  by  [20,  28,  57,  62] 

\\f\\oo  sup  (T,r,or{t(r'”)). 

0<fi<7n 
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The  two  induced  norms  are  related  by  [4] 


llTiloo  <  Ciimi,  <  C72(iV)|!t(U, 

where  Ci  is  a  constant  depending  only  on  the  dimension  of  the  matrix  T,  and  C2  is  a 
linear  function  of  the  McMillan  degree  JV  of  t.  In  other  words,  every  system  inside  li  is 
also  inside  Hoot  but  the  converse  is  not  true.  This  means  that  there  exist  (2  stable  LTI 
systems  that  are  not  stable;  an  example  is  the  function  with  the  A-transform  given 

by  (4); 

t(A)  =  eT^. 

Thus,  for  LTI  systems,  minimizing  the  ti  norm  guarantees  that  the  Hoc,  norm  is  bounded. 
This  means  that  this  system  will  have  good  /2-<Ilsturb€mce  rejection  properties  as  well  as 
^00-disturbance  rejection  properties.  Also,  the  li  norm  is  more  closely  allied  with  BIBO 
stability  notions  and  hence  quite  desirable  to  work  with.  The  disadvantage  in  working 
with  the  l\  norm  is  the  fact  that  it  is  a  Banach  space  of  operators  operating  on  a  Banach 
space,  not  a  Hilbert  space  itself.  Many  of  the  standard  tools  are  not  usable;  however, 
this  chapter  will  present  new  techniques  for  handling  problems  of  this  kind. 

2.5  Prototype  Problems 

In  this  section  we  demonstrate  the  advantages  of  using  the  too  signal  norm  by  presenting 
a  few  prototype  problems.  For  each  problem,  certain  control  objectives  related  to  the  loo 
norm  are  to  be  met.  These  problems  demonstrate  the  advantages  of  using  the  loo  signal 
norm  as  a  means  of  capturing  time-domain  specifications  in  an  uncertain  environment. 
Later  on,  it  will  be  shown  how  all  such  problems  can  be  treated  in  a  unified  manner 
under  a  single  framework.  We  shall  then  develop  mathematical  techniques  for  obtaining 
solutions  for  all  problems  which  fit  within  that  framework. 

2.6.1  Disturbance  Rejection  Problem 

Consider  the  system  in  Fig.  2.1.  Here  is  a  plant  and  K  a  controller,  both  LTI. 

The  system  is  subjected  to  bounded  flisturbances  which  are  reflected  at  the  plant 
output.  As  mentioned  earlier,  these  *listurbances  are  assumed  to  be  the  output  of  a 
time-invariant  filter  Wi  reflecting  the  frequency  content  of  such  disturbances.  The  control 
objective  in  this  case  will  be  to  find  a  controller  K  which  satisfies  the  following: 


0 


tu 


Figure  2.1;  Disturbance  Rejection  Problem 

1.  K  internally  stabilizes  the  feedback  system. 

2.  The  effect  of  the  disturbances  at  the  plant  output  is  minimized,  i.e.,  K  minimizes 

sup  llzlloo. 

||«>||oo<l 

2.5.2  Command  Following  in  the  Presence  of  Input  Saturation 

The  command  following  problem  is  equivalent  to  the  disturbance  rejection  problem. 
Consider  the  system  in  Fig.  2.2.  The  plant.  P,  suffers  from  saturation  nonlinearities  at  its 


Figure  2.2:  Command  Following  with  Input  Saturation 


in 


input.  Therefore,  it  can  be  viewed  as  having  two  components:  a  saturation  component, 
Sat(.),  and  an  LTI  component,  Pg-  The  saturation  component  is  defined  as  follows: 


Sat{u) 


«  |«l  < 

1*^1  ^  t^max 


As  a  result  the  plant  is  described  as  P  =  P<,  Sat{-).  Because  of  the  presence  of  the 
saturation,  the  plant  input,  u,  must  not  be  allowed  to  exceed  Umam-  This  requirement 
can  be  captured  in  a  natural  way  using  the  norm  of  u.  In  other  words,  u  must  satisfy 
||w||oo  <  Umax- 

The  coiimiand,  r,  is  to  be  followed  at  the  plant  output.  It  is  not  fixed  but  rather  can 
be  any  command  in  the  set 


{r  -Ww  :  ||t«||oo  <  1), 


where  W  reflects  the  frequency  content  of  the  desired  commands  and  is  typically  a  low 
pass  filter. 

The  control  objectives  can  now  be  stated  more  precisely.  It  is  desired  to  find  a 
controller  K  so  that: 


1.  K  internally  stabilizes  the  system. 

2.  ||«||oo  <  Umax- 

3.  y  follows  r  uniformly  in  time  to  within  a  maximum  error  level  of  7  >0,  i.e., 

||y-  »'||<x.  <  1- 

2.5.3  Robust  Disturbance  Rejection 

In  the  previous  two  problems,  the  plant  was  assumed  to  be  known  exactly.  This  is  rarely 
the  case  due  to  unmodelled  dynamics,  parameter  variations,  etc.  When  the  controller 
designed  for  a  nominal  plant  model  is  implemented  on  the  real  system,  there  are  no 
guarantees  on  the  resulting  performance  of  the  system.  Even  requirements  as  basic  as 
stability  may  not  be  met.  The  deviation  from  the  expected  behavior  of  the  system 
clearly  depends  on  the  accuracy  of  the  model.  Since  modelling  uncertainty  is  inevitable, 
it  is  imperative  to  include  stability  and  performance  robustness  to  model  uncertainty 
as  a  design  objective.  We  now  take  a  second  look  at  the  disturbance  rejection  problem 
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Figure  2.3:  Robust  Disturbance  Rejection  Problem 

discussed  earlier.  Instead  of  considering  a  single  nominal  time-invariant  plant,  we 
shall  instead  consider  a  collection  of  plants.  The  class  of  plants  considered  is  taken  to  be 

n  :=  (p  =  P„  -I-  W3AW2  :  A  is  causal  and  ||A||  :=  *^f“**°°  <  1 

where  Wi  and  W2  are  time-invariant  weighting  functions.  In  this  definition,  the  plant 
perturbation.  A,  may  be  time-varying  and/or  nonlinear.  Any  plant  belonging  to  this 
plant  class  is  said  to  be  admissible.  Note  that  when  A  =  0,  we  iv.-tover  the  nominal  LTI 
plant.  Consequently,  the  collection  of  admissible  plants,  11,  may  be  viewed  a  ball  of 
plants  centered  around  the  nominal  time-invariant  plant  model.  If  a  system  property, 
such  as  stability,  holds  for  all  admissible  plants  it  is  said  to  be  robust.  We  now  add  to 
our  original  disturbance  rejection  problem  a  new  objective:  robustness.  In  other  words, 
the  controller  K  is  now  required  to  perform  the  following  tasks: 

1.  K  internally  stabilizes  all  admissible  plants,  i.e.,  all  plants  in  the  class  11. 

2.  K  minimizes  the  effect  of  the  disturbance  xr  on  the  magnitude  of  the  outpiit  for 

the  worst  possible  admissible  plant,  i.e.,  K  minimizes  sup  sup  |(y||oo- 

fen||u;||o.,<i 

2.5.4  Robustness  in  the  Presence  of  Coprime  Factor  Perturbations 

Another  approach  to  the  representation  of  jdant  uncertainty  is  through  coprime  factor 
perturbations  [5,  26].  Let  Po  =  NM~^  be  a  copriine  factorization  of  the  nominal  plant. 
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Figure  2.4:  Coprime  Factor  Perturbations 


The  graph  of  the  plant  Po  over  the  space  loo  is  define  as  the  image  of  the  space  loo  imder 
the  map  Gp^  where 


Gp„  :  foD  ^oo  X  fo 


^  fMul 

The  class  of  admissible  plants  can  be  defined  as  those  plants  whose  graph  is  perturbed 
in  following  way: 

n  =  {f  :  CJp  =  [  ,  IIAxll  <  1,  IIA2II  <  1}  . 


This  plant  class  can  be  viewed  as  that  obtained  by  perturbing  the  plant  numerator  and 
the  plant  denominator  independently  as  shown  in  Fig.  2.4.  The  main  objective  in  this 
case  is  to  find  a  controller  K  which  stabilizes  all  plants  in  the  class  11. 


2.5.5  A  Multiobjective  Control  Problem 

In  almost  all  practical  control  problems,  more  than  one  objective  must  be  met  simulta¬ 
neously.  Perhaps  one  of  the  most  attractive  features  of  the  present  approach  is  its  ability 
to  handle  multiple  objectives  in  a  natural  way.  As  an  example  of  a  multiple  objective 
problem  consider  the  system  in  Fig.  2.5.  In  the  figure  the  plant  is  subjected  to  multi¬ 
plicative  output  perturbations.  In  addition  it  has  a  saturation  nonlinearity  at  its  input  of 


Figure  2.5:  Multiobjective  Problem 

the  type  discussed  earlier.  A  command  input,  r,  is  applied  while  a  bounded  disturbance, 
d,  is  acting  at  the  plant  output.  The  objectives  in  this  problem  are  a  combination  of 
those  objectives  in  the  first  three  problems  discussed  earlier.  Aside  from  stabilizing  all 
admissible  plants,  the  controller  must  also  ensure  that  the  plant  input,  u,  never  exceeds 
its  maximum,  if  max  ^  despite  the  presence  of  the  output  disturbance,  the  command  input, 
and  the  plant  uncertainty.  Furthermore,  the  tracking  error  in  this  unfriendly  environ¬ 
ment  must  be  maintained  at  a  minimum  level  for  all  time.  These  requirements  on  the 
controller  are  summarized  as  follows: 

1.  K  stabilizes  all  plants  in  fl. 

2.  K  is  chosen  so  that  sup  sup  ||u||oo  S  l^max- 

||u),||oo<i 

3.  K  is  chosen  so  that  sup  sup  llc|)oo  is  minimized. 

ll>".iloo<i  Pen 

Comment:  It  is  possible  in  this  formulation  to  include  time- varying  weights  with  which 
one  can  emphasize  certain  periods  of  the  time  response.  The  general  framework  and 
solutions  presented  in  the  sequel  generalize  in  the  presence  of  such  weights;  however,  we 
will  restrict  our  discussion  to  the  time-invariant  case. 
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Figure  2.6:  The  Robust  Performance  Problem 

2.6  A  General  Formulation:  The  Robust  Performance 
Problem 

In  the  previous  section,  we  have  formulated  sample  control  problems  which  reflect  var¬ 
ious  practical  control  requirements.  Two  assumptions  were  embedded  in  the  problem 
statement.  The  first  of  these  is  that  the  conunand  signals  and  the  disturbance  signals 
do  not  necessarily  decay  in  time  but  can  instead  persist  over  all  time  so  long  as  they 
are  bounded.  This  is  a  fairly  realistic  assumption  and  leads  to  the  adoption  of  the 
norm  to  measure  the  signal  size.  The  second  consists  of  requiring  the  regulated  signals 
of  interest  to  have  small  maximum  amplitudes.  Thus,  once  more,  the  signal  norm  is 
used  as  a  measure  for  signal  size,  but  this  time  it  is  the  regulated  output  signals  which 
are  being  measured.  When  considering  that  quite  often  the  output  of  interest  is  a  track¬ 
ing  error,  plant  input  and/or  plant  output,  it  becomes  clear  that  limiting  the  maximum 
value  these  signals  can  achieve  is  desirable  if  not  necessary.  As  a  means  for  obtaining 
a  unifying  framework  for  formulating  and  solving  a  wide  variety  of  problems  with 
signal  norms  and  induced-norm  bounded  perturbations,  we  set  up  the  Robust  Perfor¬ 
mance  Problem.  All  the  prototype  problems  discussed  in  the  previous  section  are  special 
cases  of  this  general  problem.  So  consider  the  system  in  Fig.  2.6:  A  models  the  system 
uncertainty,  K  is  the  controller,  and  G’„  contains  the  remaining  part  of  the  system.  It  is 
assumed  that  A  belongs  to  the  following  class: 


'P(n)  :=  {A  =  dia9(Ai, . . . ,  An)  :  A;  is  causal  and  ||Aj|l  <  1} . 


Here  ||Ai||  is  the  induced  too  norm,  i.e.,  ||A<||  =  sup^^o  H .  In  the  sequel,  the  A/s 
are  assumed  to  be  SISO  for  simplicity.  There  is  no  time-invariance  restriction  on  the 
perturbations,  and  hence  time- varying  and/or  nonlinear  perturbations  are  allowed.  The 
diagonal  structure  of  the  perturbations  is  essential  for  incorporating  information  about 
the  location  of  the  system  uncertainty.  For  example  actuator  unmodelled  dynamics  are 
not  related  to  sensor  unmodelled  dynamics  or  to  the  plant’s  unmodelled  high-frequency 
dynamics,  and  should  not  be  modeled  by  the  same  perturbation  block.  By  isolating  the 
independent  sources  of  uncertainty,  a  more  realistic  and  less  conservative  system  model 
is  obtained.  This  is  the  main  reason  for  considering  structured  perturbations.  While 
A  models  the  uncertain  part  of  the  system.  Go  is  the  known  part  of  the  system  with 
the  exception  of  the  controller,  and  it  is  a  3  x  3  block  matrix.  The  actual  system  is 
an  element  in  the  upper  linear  fractional  connection  of  Go  and  the  adtnissible  A’s.  So 
included  in  Go  is  the  nominal  plant/plants,  any  input  and  output  weighting  functions, 
and  any  weighting  functions  on  the  perturbations.  We  shall  restrict  the  weights  and  the 
nominal  plant  to  be  LTI.  As  a  result.  Go  is  LTI.  The  signal  w  denotes  all  exogenous 
inputs,  including  the  command  inputs  and  the  disturbance  inputs  which  are  assumed  to 
be  in  (oo,  while  z  denotes  the  regulated  outputs.  Both  u;  and  z  are  allowed  to  be  vector 
signals.  From  now  on,  we  shall  refer  to  the  map  taking  u»  to  r  as  T^u,.  The  induced  foo 
norm  of  Tzu)  is  defined  as  follows: 


I17;u^||  :=  sup 

w/0 


IIh’IIoo 


Finally,  the  controller  K  is  assumed  to  be  I/Fl.  We  are  now  ready  to  state  the  Robust 
Performance  Problem. 


Robust  Performance  Problem:  Find  a  controller  K  so  that 

1.  The  system  achieves  robust  stability,  i.e.,  K  internally  stabilizes  the  system  for  all 
admissible  perturbations,  i.e.,  for  all  A  in  V{n). 

2.  The  system  achieves  robust  performance,  i.e.,  K  is  chosen  so  that 

snp  ||T-„.||  <  1. 

Arp(„) 

As  mentioned  earlier,  the  prototype  problems  discussed  can  all  fit  in  this  framework. 
As  an  example,  for  the  Disttirbance  Hejection  Problem  since  the  number  of  perturbation 


Ifi 


blocks,  n,  is  zero,  Go  has  only  two  inputs  w  and  «,  and  two  outputs  z  and  y.  As  a  result 
G„  has  the  form: 


This  is  referred  to  as  the  nominal  performance  problem. 

On  the  other  himd,  for  the  robust  disturbance  rejection  problem  n  will  be  1.  Thus, 
Go  has  an  additional  input  fed  from  the  perturbation  output,  and  an  additional  otitput 
feeding  the  perturbation  input.  It  follows  that  Go  has  the  following  structure: 

/  0  0  -W2Po\ 

Wx  -Po  . 

\W3  Wi  -Po  / 

And  so  on. 

2.7  Robustness  Conditions 

Having  stated  the  Robust  Performance  Problem,  we  can  now  focus  our  attention  on  its 
solution.  In  particular,  we  shall  develop  necessary  and  suRicient  conditions  for  achieving 
both  performance  robustness  and  stability  robustness.  These  conditions  will  be  used  for 
the  robustness  analysis  of  the  systenr  at  hand.  In  this  case,  the  controller  is  assumed 
given  and  fixed  and  its  effect  on  the  robustness  of  the  system  is  investigated.  The 
same  conditions  developed  for  robustness  analysis  are  used  to  develop  techniques  for  the 
synthesis  of  robust  controllers. 

We  begin  by  discussing  the  robustness  analysis  issue.  Suppose  we  are  given  a  nom¬ 
inal  system  <?<,,  a  perturbation  class  T>(n),  and  a  controller  K  connected  as  shown  in 
Fig.  2.6.  We  can  incorporate  Go  and  K  together  and  view  them  as  one  system,  M ,  as 
shown  in  Fig.  2.7.  Thus  M  will  have  two  inputs  and  two  outputs.  We  will  assume  that 
the  controller  K  stabilizes  the  nominal  system  otherwise  robust  stability  and  hence 
performance  clearly  will  not  be  achieved.  Consequently,  M  will  be  LTI  and  stable.  We 
will  say  the  system  in  Fig.  2.7  achieves  robust  stability  if  it  is  stable  for  all  admissible 
perturbations.  We  will  say  that  it  achieves  robust  performance  if,  in  addition,  ||7^ui||  <  1 
for  all  admissible  perturbations.  We  can  now  state  the  following  problem  whose  solution 
is  provided  in  the  next  two  sections: 

Robustness  Analysis  Problem  Under  what  conditions  on  M  will  the  system  in 
Fig.  7  achieve  robust  performance? 
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Figure  2.7:  Robust  Performance  Problem  in  M-A  form 

2.7.1  Stability  Robustness  vs.  Performance  Robustness 

It  is  an  interesting  fact  that  a  robust  performance  problem  can  be  transformed  to  a  robust 
stability  problem.  This  has  been  shown  in  [22,  21,  47)  when  the  perturbations  are  LTI 
with  an  L2  induced-norm.  This  remains  true  in  our  case  as  well,  although  the  method 
of  proof  is  quite  different.  To  elaborate  further  on  this  relationship  between  stability 
robustness  and  performance  robustness  consider  the  two  systems  shown  in  F*g.  2.8. 
System  I  corresponds  to  a  performance  robustness  problem,  while  System  II  is  formed 


System  I 


System  II 


Figure  2.8:  Stability  Robustness  vs.  Performance  Robustness 


from  System  I  by  feedin'^  z  back  to  wj  through  a  fictitious  perturbation,  Ap,  satisfying 
IIApII  <  1.  As  a  result,  System  II  has  T)(n  +  1)  as  its  perturbation  class.  We  can  now 
ask  the  following  question:  How  does  the  performance  robustness  of  System  I  relate  to 
the  stability  robustness  of  System  II  ?  One  aspect  of  the  relationship  between  the  two 
notions  of  stability  is  fairly  obvious:  performance  robustness  of  System  I  implies  stability 
robustness  of  System  II.  This  is  quite  easy  to  see.  Since  robust  performance  is  equivalent 
to  the  norm  of  the  map  between  w  and  ::  being  less  than  one,  the  Small  Gain  Theorem 
can  be  used  to  establish  the  stability  of  System  II  for  all  ||Ap|l  <  1,  or  equivalently 
to  establish  the  robust  stability  of  System  II.  Equally  important,  the  relation  between 
stability  robustness  and  performance  robustness  holds  the  other  way  as  well.  In  other 
words,  stability  robustness  of  System  II  implies  performance  robustness  of  System  I. 
This  direction  is  not  as  obvious  as  the  first  one.  The  proof  follows  from  certain  results 
on  the  robustness  of  lime- varying  systems. 

2.7.2  Stability  Robustness  Conditions 

Because  performance  robustness  is  equivalent  to  stability  robustness  in  the  sense  dis¬ 
cussed  earlier,  we  need  only  discuss  stability  robustness.  Specifically,  we  can  consider 
the  interconnection  of  a  stable  LTI  system,  Af ,  with  a  structured  perturbation  A  £  'D{n) 
in  Fig.  2.9,  and  seek  necessary  and  sufficient  conditions  for  the  stability  robustness  of  the 
system.  Since  M  and  A  are  both  stable,  the  internal  stability  of  the  system  is  equivalent 


M 

A 

Figure  2.9:  Stability  robustness  problem 

to  the  map  /  -  MA  having  a  stable  inverse,  one  which  maps  to  itself  with  a  finite 
gain.  When  the  signal  norm  is  the  (2  norm  and  the  perturbations  are  time-invariant, 
the  conditions  are  provided  by  the  Structured  Singular  Value,  the  function  //  [22].  In 


particular,  robustness  is  achieved  iff  sup  <  1.  In  our  formulation,  it  turns 

0£«<2ir 

out  that  the  conditions  are  much  simpler  and  easier  to  compute  than  fi.  Before  we  can 
present  these  conditions  we  need  to  define  a  certain  nonnegative  matrix,  M,  which  de¬ 
pends  solely  on  M.  Recalling  M  has  n  inputs  and  n  outputs,  it  can  be  partitioned  as 
follows: 

A/ll  •  •  • 

A/  =  :  : 

.  ^nl  •  •  ‘ 

Each  M,j  is  LTI  and  stable,  and  thus  Mij  £  Clearly  ||A/,j||i  can  be  computed  with 
arbitrary  accuracy  by  considering  finite  truncations  of  Mij  as  approximations.  We  can 
now  define  A/  as  follows: 

■||A/ii||i  ...  IIAfinlli 

A/  =  :  : 

.||M„i|ii  ...  ||A/„„||i 

One  of  the  most  interesting  aspects  of  the  robustness  problem  formulated  here  is  the 
role  which  M  plays  in  the  system  robustness.  This  is  presented  in  the  next  theorem  due 
to  Khammash  and  Pearson  (.'1.3,  34,  .35]. 

Theorem  2.7.1  The  system  in  Fig.  2.9  possesses  robust  stability  iff  any  one  of  the 
following  holds: 

1.  p{M)  <  1,  where  p{.)  denotes  the  spectral  radius. 

2.  X  <  Mx  and  x  >  0  imply  that  r  -  0,  where  the  vector  inequalities  are  to  be 
interpreted  componentwise. 


3.  inf  A//Z|li  <  I,  where  K  :  {«/;o^(ri. . . .,  r,,)  :  r,  >0}. 

Reft 

One  of  the  main  contributions  of  this  theorem  is  that  it  i)rovides  simple  and  ex¬ 
act  conditions  for  testing  the  -tern’s  stability  ro1>ustness  regardless  of  the  number  of 
perturbation  blocks,  n.  While  (he  three  coiidilions  in  the  theorem  are  equivalent,  each 
provides  a  different  perspective  and  has  c«‘rtain  advantages  over  the  others.  For  example, 
the  spectral  radius  condition  is  in  general  the  easiest  to  compute.  It  is  particularly  useful 
when  n  is  large  since  it  can  he  computed  efliciently  using  power  methods.  Specifically, 
given  an  M  which  is  assumed  primitive  (i.e.,  A/*"  0  for  some  integer  k),  then  it  satisfies 


the  following: 


.  (A/*’<'r), 

mm  — - 

’  (A/*-.r), 


p{M)  max 


(A/*^*  ’.t), 

(T/'-r), 
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for  any  vector  a;  >  0.  Furthermore,  the  upper  and  lower  bounds  both  converge  to  p(M) 
as  k  goes  to  infinity.  If  M  were  not  primitive,  it  can  be  perturbed  slightly  to  become 
primitive. 

Whereas  the  spectral  radius  test  provides  a  yes  or  no  answer  concerning  system  ro¬ 
bustness,  the  second  test  involving  the  Linear  Matrix  Inequality  (LMI)  is  most  useful 
for  providing  information  about  the  effect  of  the  individual  entries  of  M  on  the  overall 
robustness  of  the  system.  This  is  achieved  by  translating  the  LMI  condition  into  n  alge¬ 
braic  conditions  stated  explicitly  in  terms  of  the  entries  of  M.  This  is  best  demonstrated 
by  an  example.  Suppose  M  is  a  2  x  2  matrix  corresponding  to  a  certain  robustness 
problem  with  n  =  2.  The  LMI  condition  states  that  robust  stability  iff  the  system 


2:1  <  ||Mii||ia:i  +  ||Mi2||i®2 
^2  <  Pf2l||ia;i  +  ||M22||i*2 


has  no  solution  x  =  {xi,X2)  6  [0, 00)  x  [0,  oo)\{0}.  Among  other  things,  this  implies 
that  II Mu  111  <  1;  otherwise  x  =  (1,0)  would  be  a  solution  for  the  two  inequalities.  The 
first  inequality  can  be  rewritten  as 


< 


||M, 


2111 


■^2- 


l-||Mi,||i 

When  combined  with  the  second  inequality,  we  have  that 


has  no  solution  in  (0,  00),  which  is  equivalent  to 


I|M2i1I, 


1  -  IIMnlli 


+  Pf22||l  <  1- 


This  last  condition,  together  with  the  condition  that  ||Mi]||]  <  1,  is  therefore  necessary 
for  the  inequality  robustness  conditions  to  hold.  Be  retracing  our  steps  backwards,  it 
becomes  clear  that  they  are  also  sufficient.  This  ])rocedure  of  constructing  explicit  norm 
conditions  from  the  second  robustness  conrlition  ran  be  repeated  in  the  same  way  for 
any  n. 

Finally,  the  third  robustness  comlilion  is  useful  for  robust  controller  synthesis.  This 
will  be  discussed  in  more  detail  later  on. 
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Equivalence  of  the  Robustness  Conditions  in  Theorem  2 

Before  we  shed  more  light  on  the  proof  of  Theorem  2,  we  will  show  that  the  three, 
apparently  imrelated,  conditions  in  the  statement  of  the  theorem  are  indeed  equivalent. 
We  will  show  that  /  2  and  that  1  0  5.  For  simplicity,  we  will  do  this  for  an 

irreducible  M.  So  suppose  that  p(M)  <  1.  It  follows  that  (/  -  M)~^  exists.  Since 
+  M  +  +  . . . ,  all  of  its  entries  will  be  positive.  Now  if  a;  >  0  is  such 

that  X  <  Mx,  or  equivalently,  (I  -  M)x  <  0,  then  multiplying  both  sides  by  (7  -  M)“’ 
implies  that  x  <  0.  Thus  x  must  be  zero.  This  is  what  2  states.  To  show  that  2 
implies  1,  suppose  /  does  not  hold,  i.e.,  that  p{M)  >  1.  The  Perron- Frobenius  theory  for 
nonnegative  matrices  states  that  p(M)  is  itself  an  eigenvalue  of  M.  Moreover,  associated 
with  p{M)  we  can  find  an  eigenvector  x'  >  0.  This  implies  that  p{M)x'  =  Mx',  which 
in  turns  implies  that  2  does  not  hold.  Thus,  we  have  demonstrated  that  1  2. 

We  now  show  /  o  5  by  showing  that  p(M)  =  infflgi?  By  definition, 

=  max^||(/?-WH).j||i  =  max^^llMijlli. 

‘  j=i  ’  j=i 

The  expression  on  the  right  is  also  equal  to  the  induced  norm  of  the  matrix  R~^MR 
as  a  map  from  (m",  ||.|l<x,)  to  itself.  Referring  to  this  norm  by  |.|i,  we  therefore  have 
||7Z~^A/i?||i  =  |iZ“^A7iZii.  Since  any  matrix  norm  bounds  from  above  the  spectral  radius 
of  that  matrix  we  have: 

mf  ||fl->A7f?||i  =-■  mf  |ft-'A?/?|,  />(/?-' A?/?)  =  p(M). 

But  if  we  choose  R  —  diag(r'^, . . . ,  r|, ),  where  (r^, . . . ,  )'  is  the  positive  eigenvector  cor¬ 

responding  to  the  eigenvalue  p{M),  the  inequality  becomes  an  equality  and  the  equiv¬ 
alence  between  1  and  3  is  established.  It  is  interesting  to  note  that  for  the  optimiun 
scalings  R  =  diag{r'^,.  ..,r,',),  all  the  rows  of  R~^  M  R  have  the  same  norm.  As  will  be 
demonstrated  shortly,  this  fact  is  used  to  show  why  condition  3  in  the  above  theorem  is 
necessary  for  system  robustness. 

Proof  of  Necessity  and  Sufficiency 

When  n  =  1,  the  spectral  radius  condition  in  the  theorem  above  reduces  to  the  condition 
<  1.  A  simple  application  of  the  Small  Gain  Theorem  shows  that  this  condition 
is  sufficient  for  stability.  Necessity  has  been  shown  by  Dahleh  and  Ohta  [9].  For  n  larger 
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Figure  2.10:  Scaled  System 

than  one,  we  now  show  that  inf/jeiz  ||i?“*MjR||i  <  1  is  sufficient  for  robust  stability. 
We  do  this  with  the  aid  of  Fig.  2.10  obtained  via  the  addition  of  scalings  R  and 
where  R  €  R.  Clearly,  the  robustness  of  this  system  and  that  in  Fig.  9  are  equivalent 
in  the  sense  that  if  one  is  robustly  stable,  then  so  is  the  other  one.  Moreover,  for 
the  system  in  Fig.  2.10,  RAR~^  belongs  to  V{n)  whenever  A  belongs  to  T>{n),  and  thus 
||iZAi2"^||  <  1.  That  being  the  case,  the  Small  Gain  Theorem  can  be  invoked  to  conclude 
that  <  1  is  sufficient  for  robust  stability.  This  holds  for  any  R  e  R.  The 

least  conservative  sufficient  condition  obtainable  in  that  manner  is 

mf  <  1. 

We  now  demonstrate  that  infngT?  <  1  is  necessary  for  robust  stability. 

For  simplicity,  we  do  this  for  the  case  n  =  2.  The  approach  will  be  to  show  how  one 
can  construct  a  destabilizing  perturbation  A  e  T>{2)  whenever  inf/jgTj  >  1- 

So  suppose  that  inf/jg^  M f?||i  >  1.  We  have  previously  shown  that  this  infimum 
is  in  fact  a  minimum,  and  it  is  achieved  by  an  optimum  scaling,  R,  obtained  from  the 
eigenvector  corresponding  to  p{M).  It  was  also  shown  that  the  two  rows  of  R-^MR  will 
have  equal  norms.  This  can  be  expressed  as  follows: 

where  {R~^MR)i  denotes  the  ith  row  of  R~^MR.  The  system  R-^MR  appears  in 
Fig.  2.11  and  has  as  its  input  ^  =  (^,,^2)  and  output  2  =  (21,^2).  In  the  figure, 
y  =  (yi^yz)  consists  of  the  output  r  -  (21,  r2)  after  a  bounded  signal,  the  output  ol 
a  sign  function,  has  been  added  to  it.  This  bounded  signal  will  be  interpreted  as  an 
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Figure  2.11:  Scaled  System  with  Constructed  Input  ^ 


external  signal  injected  for  stability  analysis.  The  strategy  taken  will  be  to  construct  ^ 
satisfying  the  two  requirements: 

1.  ^  is  unbounded. 

2.  (  results  in  a  signal  y  which  satisfies  ||Pfc£t||i  <  HFVyilli  for  i  =  1,2,  where  Pfc  is 
the  truncation  operator  which  acts  on  sequences  by  preserving  the  first  ib  4- 1  terms 
and  setting  the  rest  to  zero. 

The  first  requirement  on  (  guarantees  that  if  an  admissible  perturbation  A  were  to 
map  y  to  it  would  be  a  destabilizing  one  because  the  bounded  external  signal  would 
have  produced  an  unbounded  internal  signal  (.  The  second  requirement,  guarantees 
that  such  an  admissible  perturbation  exists.  In  other  words,  if  (  and  y  satisfy  the  second 
condition,  then  it  is  possible  to  find  A,,  for  ?  =  1,2,  so  that  A;  is  causal,  has  induced 
norm  less  than  or  equal  to  one,  and  satisfies  A,y,  =  (j.  If  the  first  requirement  is  also 
met,  this  A  will  be  a  destabilizing  perturbation. 

For  simplicity  we  shall  assume  that  all  Afij's  have  finite  impulse  response  of  length, 
say  N.  The  construction  of  ^  proceeds  as  follows.  While  maintaining  |^,(A:)|  <  1 
for  fc  =  0, . . . ,  iV  -  1,  the  first  N  components  of  (  can  be  constructed  so  as  to  achieve 
||(i2“^MiZ)i||i.  Since  IKP-* Af P)i ||i  >  I,  this  implies  that  ||P7v_iz||<x)  >  1,  which  in 
turn  implies  that  ||P/v-iy||oo  >  2.  Next,  while  still  maintaining  <  1,  we  pick  the 

next  N  components  of  (  so  as  to  achieve  the  second  row  norm,  ||(/?~^Afii)2||i.  As  a 
result  we  have  |lP2Af-i2i||oo  >  1  which  implies  that  |lP2A"-iyi||oo  >  2.  Note  that  the 
second  requirement  on  (  has  been  met  for  ^  —  0, ... ,  27V  -  1.  In  addition,  because  of  the 
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way  the  first  2N  terms  of  ^  have  been  constructed,  we  have 


||f^2A?-iyi||oo  >  ||f’2N-lCiil<»  +  1  I  =  1,2. 

This  allows  us  to  relax  the  restriction  on  |^t(^)|  for  ^  >  2iV  —  1  without  violating  the 
second  requirement  on  Specifically,  we  now  allow  |^,(Ar)|  to  be  as  large  as  2  for 
k  =  2N, . .  .,4JV  -  1.  In  the  same  way  as  before  we  can  pick  ^{k)  for  this  range  of  k  so 
that  we  satisfy 

||AAr-il/t||oo  >  il-RiN-i^tlloo  +  1  i  =  1,2. 

which  allows  us  to  increase  |^<(Jb)|  by  1  for  the  next  2N  components  of  and  repeat 
the  whole  procedure  again.  From  this  construction,  it  is  clear  that  when  ^  is  completely 
specified  it  will  be  unbounded  and  hence  meets  the  first  requirement.  The  second  re¬ 
quirement  is  also  met  since  all  along  ^i(k)  was  chosen  carefully  so  as  not  to  become  too 
large  too  soon. 

It  should  be  mentioned  that  the  destabilizing  perturbation  can  be  taken  to  be  linear 
time- varying  (LTV),  or  it  can  instead  be  nonlinear  time-invariant.  So  the  spectral  radius 
condition  for  robustness  is  also  necessary  and  sufficient  whenever  the  class  of  perturbation 
is  restricted  to  include  norm-bounded  nonlinear  time-invariant  perturbations. 

Construction  of  the  Destabilizing  Perturbation 

In  the  previous  section,  we  have  claimed  that  given  (  =  {^(t)}“o  €  fooe  V  - 
{y(*)}~0  €  foo.e  SO  that  ||Fj.^,||oo  <  ||FV-iyi||ooVfr,  and  for  t  =  1,2,  then  there  exists 
A  =  diag{Ai,A2)  such  that  Ay  —  ^  and  l|A,l|  <  1.  Such  a  A  was  shown  to  be  a 
destabilizing  perturbation.  In  this  section,  we  prove  this  claim  by  explicitly  constructing 
the  perturbation  A.  It  turns  out  that  Aj  can  be  either  LTV  or  nonlinear  and  time- 
invariant.  We  shall  construct  Ai  to  be  of  the  former  type,  while  Aj  will  be  of  the  latter 
type. 

So  suppose  we  are  given  Vi  =  {yi(*)}“o  ^  foo.e  such 

that  ||Pfc^i||oo  <  IlflityillooVfc.  The  construction  of  Ai  is  trivial  if  yi  =  0:  just  pick  Ai 
itself  to  be  zero.  So  assume  yi  ^  0.  We  start  the  construction  of  Ai  by  identifying  a 
subsequence  of  j/i,  say  (yi(fi),yi(»2)i  •  •  •  )  which,  depending  on  yi,  may  or  may  not  be 
finite.  This  subsequence  may  be  defined  recursively  in  the  following  marmer:  Let  I’l  be 
the  smallest  integer  such  that  y^{ii)  f-  0.  Given  yi(?„),  let  be  the  smallest  integer 
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greater  that  i„  such  that  |yj(i„+i)|  >  |yi(tn)|-  Using  the  (i(iys  and  yi(ij)’s  we  are  now 
ready  to  construct  Ai  through  specifying  its  matrix  kernel  representation  as  follows: 


Notice  that  each  row  of  the  above  matrix  has  at  most  one  nonzero  element,  which,  by  the 
choice  of  the  yi(tj)’s,  will  have  its  absolute  value  less  than  or  equal  to  one.  This  implies 
||Ai||  <  1.  Moreover,  Aj  is  clearly  causal  and  it  can  easily  be  checked  that  Aij/i  =  ^i, 
which  is  what  we  wanted  to  show. 

We  now  construct  a  nonlinear,  time-invariant,  and  causal  perturbation  A2.  As  before, 
A2  must  be  so  that  IIA2II  <  1  and  A2y2  =  ^2.  Let  A2  be  defined  as  follows: 


(A2/)(*:)={J(*-*) 


if  for  some  integer  t  >  0,  =  PkSi^2 

otherwise. 


Note  that  A2  maps  y2  to  ^2  and  IIA2II  <  1. 


2.7.3  Comparisons 

It  is  worthwhile  comparing  the  class  of  perturbations  that  have  gain  less  than  unity  over 
^2  (which  eirise  in  the  standard  fi)  with  the  class  of  perturbations  that  have  gain  less  than 
unity  over  (go-  If  the  perturbations  are  restricted  to  time-invariant  ones,  the  foo-stable 
perturbations  with  gain  less  than  unity  He  inside  the  unit  ball  of  f2-stable  perturbations 
(for  the  multivariable  case,  the  unit  ball  will  be  scaled  by  a  constant).  This  follows 
directly  from  the  norm  inequality  between  f\  and  Hoo-  If  the  perturbations  are  allowed 
to  be  time-varying,  then  the  two  sets  are  not  comparable.  EarHer,  an  example  was 
presented  that  shows  that  the  Hoo  ball  is  larger  ^han  the  ball.  On  the  other  hand,  the 
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Perturbation  class 

pi(M)  <  1 

IQgQH 

NLTV,  bounded  /2-gAin 

nec 

suff 

suff 

NLTV,  boimded  /go-gain 

nec 

nec 

nec  and  suff 

NLTI,  boimded  /2-gain 

nec 

suff 

suff 

NLTI,  bounded  /go-gain 

nec 

nec 

nec  and  suff 

LTV,  bounded  /2-induced  norm 

nec 

suff 

suff 

LTV,  bounded  /gg-induced  norm 

nec 

nec 

nec  and  suff 

LTI,  bounded  /2-induced  norm 

nec  and  suff 

suff 

suff 

LTI,  bounded  /gg  induced  norm 

nec  and  suff 

suff 

suff 

Table  2.1:  Comparisons  between  different  robustness  criteria 


operator  A  defined  by 

(A/)(ir)  = /(O) 


is  (oo  stable  but  not  £2  stable. 

A  question  which  might  arise  is,  how  do  the  derived  robustness  conditions  differ  from 
the  Structured  Singular  Value?  The  answer  lies  in  the  class  of  perturbations  assmned. 
While  the  perturbations  here  may  be  nonlinear  time-varying  (NLTV),  nonlinear  time- 
invariant  (NLTI),  or  LTV  for  the  conditions  to  be  necessary  and  sufficient,  ^  theory  gives 
necessary  and  sufficient  conditions  only  for  LTI  perturbations.  In  terms  of  computation, 
the  robustness  test  proposed  here  is  much  easier  to  compute  and  gives  exact  amswers 
for  any  number  of  perturbation  blocks,  n.  On  the  other  hand,  pi  is  much  harder  to 
compute  especially  since  for  n  >  3  only  an  upper  bound  can  be  computed.  One  can  use 
the  small  gaiin  theorem  to  get  sufficient  conditions  for  robust  stability  in  the  presence  of 
NLTV  induced  norm-bounded  pert\nbations  in  the  same  way  it  was  done  for  the  A 
norm.  In  this  case,  a  sufficient  condition  would  be  infn^Tj  \\R~^MR\\ff^  <  1.  It  is  not 
known  whether  this  condition  is  also  necessary.  However,  it  is  not  sufficient  to  guarantee 
robustness  when  perturbations  of  the  type  considered  in  this  chapter  are  present,  i.e., 
for  Zoo  induced  norm-bounded  perturbations.  In  contrast,  robustness  in  the  presence 
of  (00  induced-norm  bounded  perturbations  does  imply  robustness  to  I2  induced-norm 
bounded  perturbations.  The  relationship  between  the  various  robustness  conditions  is 
summarized  in  Table  1  (In  the  table:  nec,  suff  respectively  mean  necessary  and  sufficient). 

In  terms  of  robust  controller  synthesis,  the  controller  must  be  chosen  so  that  p(M) 
is  minimized.  The  dependence  of  M  on  the  controller  is  reflected  through  the  Youla 
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parameter,  Q,  since  M  can  be  expressed  as  [28,  57,  61] 

M  =  M(Q)  =  Ti-  T2QT3, 


where  the  Tj’s  depend  only  on  Gg.  Because  p(M)  —  ||ii?~^AfiZ||i,  the  robustness 

synthesis  problem  becomes  one  of  finding 


inf  inf 

g  stable 

With  Q  stable  and  fixed,  we  have  seen  that  picking  the  eigenvector  associated  with 
p{M{Q))  will  yield  the  minimum  value  over  all  scalings  in  TZ.  When  R  is  Axed,  we  have 
an  fi-norm  minimization  problem.  This  problem  and  its  solution  will  be  discussed  in 
the  remaining  part  of  the  chapter.  So  the  approach  which  wiU  be  taken  to  solving  the 
robustness  synthesis  problem  is  to  start  with  an  initial  R  £  R.  For  that  R  we  find 
the  optimal  Q  resulting  from  the  norm  minimization  problem.  We  then  fix  that  Q  and 
solve  for  the  optimal  R  associated  with  this  new  Q  and  so  on.  Since  at  each  step  the 
objective  function  gets  smaller  and  smaller,  and  since  it  is  bounded  from  below  by  zero 
it  is  guaranteed  to  converge  to  some  value.  Unfortunately,  this  value  may  not  be  the 
global  minimum.  If  at  that  point,  a  satisfactory  level  of  performance  robustness  has 
been  reached,  we  can  stop  and  use  the  final  Q  to  construct  the  controller.  Otherwise, 
the  iteration  process  should  be  restarted  with  a  different  initial  scaling  matrix  in  11. 
This  scheme  is  similar  to  the  so-called  D  -  K  iteration  used  in  the  /i-synthesis  technique 
[22,  21|.  The  main  difference  is  that  while  the  scales  used  for  /i-synthesis  eire  frequency 
dependent  and  a  convex  optimization  problem  must  be  solved  at  each  frequency,  the 
scalings  here  are  not  frequency  dependent  and  can  be  readily  found  by  computing  the 
eigenvector  associated  with  p(M).  Such  a  computation  can  be  done  very  effectively  using 
power  methods,  and  no  optimization  problem  need  be  solved  to  find  the  optimal  scalings. 


2.8  Synthesis  of  the  controller 

As  stated  earlier,  the  fi  minimization  problem  is  given  by: 

/to=  inf  ||T,  -  {OPT) 

Q  stable 

In  this  section,  we  will  show  that  this  problem  is  equivalent  to  a  linear  programming  prob¬ 
lem  in  an  infinite-dimensional  space.  By  utilizing  the  duality  theory  of  Lagrange  multi¬ 
pliers,  it  is  shown  that  in  some  cases  the  linear  programs  are  in  fact  finite-dimensional 
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and  thus  exact  solutions  for  (OPT)  can  be  obtained.  For  the  rest  of  the  cases,  the  duality 
theory  provides  upper  and  lower  approximations  of  the  optimal  solution.  The  use  of  the 
Lagremge  multiplier  theory  highlights  the  strong  resembljince  between  the  problem 
and  standard  linear  programming  problems. 

The  admissible  subspacc  S  is  defined  as; 

5  =  6  =  T2QT3,  Q  is  stable} 

The  ti  problem  can  be  interpreted  as  a  distance  problem:  Find  an  element  in  the  subspace 
S  which  is  closest  to  the  fixed  element  Ti,  where  distance  is  measured  in  the  /i-norm. 
Previous  work  [10, 11]  used  the  duality  theory  for  distance  problems  to  arrive  at  a  solution 
for  (OPT).  Here  we  take  an  alternate  approach  using  Lagrange  multiplier  theory,  which 
is  in  fact  more  intuitive  and  transparent,  to  arrive  at  similau'  conclusions. 

2.8.1  Characterization  of  the  Subspace  S 

In  the  discussion  below,  it  is  assumed  that  Tz  has  full  column  rank  =n2,  and  T3  has 
full  row  rank  =713.  It  is  evident  that  this  captures  the  most  general  situation  since  if 
either  of  these  conditions  does  not  hold,  we  can  perform  inner-outer  factorizations  on 
and  tz  and  absorb  the  extra  degree  of  freedonr  in  Q.  Also,  it  is  assumed  that  there 
exist  n2  rows  of  fz  and  na  columns  of  tz  which  are  linearly  independent  for  all  A  on  the 
unit  circle.  This  assumption  simplifies  the  exposition  although  it  is  not  necessary.  In 
general,  it  is  enough  to  assume  the  above  for  I  point  on  the  unit  circle  [55].  Under  this 
assmnption,  tz  and  T3  can  be  written  in  the  following  form  without  loss  of  generality 
(possibly  requiring  the  interchange  of  inputs  and/or  outputs): 


tz  -  (  T31  Ts?  ) 

where  tzi  has  dimensions  nz  x  nz  and  is  invertible  and  T31  has  dimensions  713  X  713  and 
is  invertible.  Moreover,  tzi  and  tsi  have  no  transmission  zeros  on  the  unit  circle.  Thus 
R  =  tzQtz  can  be  written: 


The  objective  is  to  obtain  a  characterization  of  the  feasible  set  S.  Notice  that  Q  can  be 
uniquely  determined  from  the  equality  Rn  -  tziQtzi-  As  was  shown  in  [10,  44],  the 
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choice  of  R\\  is  constrained  by  the  zeros  of  T’21,  T31  that  are  inside  the  unit  disc.  There 
is  only  a  finite  number  of  such  zeros,  and  each  zero  is  interpreted  as  a  bounded  linear 
fimctional  on  iZu.  In  the  sequel,  we  use  the  following  terminology: 

Definition  2.8.1  A  transfer  function  G  interpolates  T21,  T31  if  GT31  is  stable. 

The  motivation  for  this  terminology  stems  from  the  fact  that  for  G^31^  to  be 
stable,  G  must  have  zeros  at  the  same  locations  and  directions  as  the  zeros  of  T21  and 
T31.  Each  zero  is  in  fact  a  bounded  linear  functional  that  annihilates  the  element  G,  and 
thus  has  a  representation  inside  the  dual  space  of  fi,  with  the  appropriate  dimension. 
If  these  functionals  are  inside  Cq,  then  we  can  view  G  as  the  annihilator  in  the  dual  of 
Co-  For  example,  let  G(a)  =  0,  where  G  is  SISO,  and  |a|  <  1.  By  definition  of  G,  we 
have  G(a)  =  Sfc>o  =  0.  Define  Za  =  (l,a*,a®, ...)  e  co,  then  the  interpolation 

condition  can  be  expressed  as  <  Za,G  >=  0.  If  a  is  a  complex  number,  then  two 
functionals  are  defined,  the  real  of  Za  and  the  imaginary  of  Za-  The  multivariable  case 
carries  more  details,  but  the  basic  idea  is  the  same  (see  [10,  44]). 

The  choice  of  flu  is  constrained  further  so  that  the  rest  of  the  equations  are  still 
consistent,  which  in  turn  dictates  a  set  of  constraints  on  the  rest  of  the  elements  of  fl. 
Define  the  following  coprime  polynomial  factorizations: 

Using  these  definitions,  we  state  the  following  result  characterizing  the  feasible  set  S  for 
this  case  [44]. 

Theorem  2.8.1  Given  T2,T3  with  the  assumptions  as  above,  and  fl  6  A,  there  exists 
Q  e  A  satisfying  R  =  T2(3T3  if  and  only  if: 


it),  (ffii 


ill),  flu  interpolates  '/u  and  Tsi 

The  conditions  shown  in  parts  i,  it  are  convolution  constraints  on  the  sequence  fl.  The 
interpolation  condition  in  the  last  part  can  be  tightened,  since  only  the  common  zeros 
of  T21  and  T22  need  to  be  interpolated. 
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The  discussion  above  shows  that  the  characterization  of  S  can  be  summarized  by 
defining  two  operators, 

V  :  IR* 


where  s,  t  are  some  integers.  The  first  operator  captures  the  interpolation  constraints, 
and  thus  has  a  finite  dimensional  range,  and  the  second  captures  the  convolution  con¬ 
straints.  These  two  operators  can  be  constructed  in  a  straightforward  fashion,  book¬ 
keeping  being  the  only  difficulty.  To  overcome  this  problem,  it  is  helpful  to  think  of  R 
as  a  vector  rather  than  a  matrix.  To  illustrate  this,  let  the  operator  W  be  a  map  from 
to  ^1*"  defined  as  follows: 

/  \ 


I 

n(k)) 


The  operator  W  is  a  one-to-one  and  onto  operator,  whose  inverse  is  equal  to  its  adjoint  (a 
fact  used  later).  It  simply  re-arranges  the  variables  in  R.  The  conditions  on  R  presented 
in  the  above  theorem  can  be  written  explicitly  in  terms  of  each  component  of  R. 

To  construct  the  first  operator  V,  recall  that  each  interpolation  condition  is  inter¬ 
preted  as  a  bounded  linear  functional  on  R.  By  stacking  up  these  functionals,  the  opertor 
V  is  constructed.  For  example,  suppose  T'21  and  t^i  are  SISO  and  both  have  N  zeros  n, 
in  the  open  unit  disc.  Then  the  matrix  V  is  given  by  V  =  V^W  where 


= 


'  i?e(a?)  0  0  0  Re(o{)  0  ...  /?e(a{)  0 

/m(ai)  0  0  0  /m(oj)  0  ...  /77i(o^)  0 

Re{a%)  0  0  0  flc(ojv)  0  ...  0 

jTn{a%)  0  0  0  /777(«7)^.)  0  ...  Iw(aj^)  0 


0,1,2,... 


For  the  second  operator,  C,  recall  that  convolution  can  be  interpreted  as  multiplication  by 
a  block  Toeplitz  matrix,  in  this  case  with  finite  memory  since  N2,  Dii  N3  and  D3  all  have 
finite  length  (the  corresponding  A-transform  is  a  polynomial).  By  simple  rearrangement. 
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the  operator  is  constructed  with  its  image  inside  /j.  Hence  C  is  given  by  C  =  TW,  where 
T  is  a  block  lower  triangular  matrix.  For  a  detailed  example,  see  [11,  44]. 

To  illustrate  the  construction  of  the  operator  T,  consider  as  an  example  the  coprime- 
factor  perturbation  problem  considered  earlier  for  a  SISO.  The  condition  for  stability 
robustness  is  given  by  [5] 

In  this  case,  T2  =  1  and  T3  =  (N  —  M).  Since  M~^N  =  NM~^  with  N,  M  coprime, 
the  conditions  in  the  above  theorem  translate  to 

(fill  fil2)(^)=0 

The  matrix  T  is  then  given  by: 

/(m(0)  n(0))  0  0  0  0 

(m(l)  Ti(l))  (m(0)  n(0))  0  0  0 

7--  (m(2)  n(2))  (m(l)  n(l))  (m(0)  u(0))  0  0 

(m(3)  n(3))  (m(2)  n(2))  (m(l)  n(l))  (m(0)  n(0))  0 

It  is  interesting  to  note  that  in  this  example  the  operator  C  captures  all  the  conditions 
and  no  interpolation  conditions  are  needed.  The  conditions  presented  in  the  theorem 
can  be  redundant,  and  can  be  significantly  reduced  [55]. 

The  subspace  S  is  then  the  set  of  all  elements  R  G  so  that  Vfi  =  0  and  CR  =  0. 
Let  61  =  VTi,  bi  —  CTi,  and  $  =  7’i  -  fi.  The  fi  optimization  problem  can  be  restated 
as: 

inf  ll^lli  subject  to  =  6],  =  ^2  (OPT). 

2.8.2  Relations  to  Linear  Programming 

It  is  well-known  that  in  finite-dimensional  spaces  f]-norm  minimization  is  equivalent  tu 
linear  programming.  This  turns  out  to  be  true  in  general,  and  can  be  justified  as  follows: 
Let  $  with  ^  0.  The  norm  is  then  replaced  by  the  function 

maxj  5Zj,fc  +  '/*?>(*’)•  Define  the  operator  Af  :  -*  IR"*  by  (A/'$)i  =  J2j,k 
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The  following  problem  is  easily  seen  to  be  equivalent  to  (OPT): 

inf 

subject  to 

-  /te  <  0 
V($i  -  $2)  =  6i 
_  $2)  =  62 
>  0 

where  e  G  IR"*  and  =  (1,1,...,  1).  It  is  interesting  to  notice  that  if  were 

restricted  to  finite  impulse  response  sequences,  the  above  problem  is  readily  a  linear 
programming  problem.  This  will  turn  out  to  be  a  crucial  observation  in  obtaining  ap¬ 
proximate  solutions,  as  will  be  described  later  on. 


2.8.3  Lagrange  Multiplier  Formulation 

Let  X  =  X  X  IR  and  Z  =  ffi.’"  x  IR’  x  IR*  x  X  ([.  Let  Px,Pz  denote  the 

positive  cones  inside  X,  Z  consisting  of  elements  with  nonnegative  pointwise  components. 
Define  the  operator  A  :  X  — >  Z,  decomposed  conformally  with  X  and  Z,  and  the  vector 
6  €  Z  as  follows: 


A  - 


Define  the  linear  functional  c*  —  I  0  I  on  A .  With  these  definitions,  (OPT)  becomes: 


( ^ 

AT 

-c '' 

(  ®  ^ 

V 

V 

0 

bi 

-V 

V 

0 

b  = 

-fri 

c 

-C 

0 

bz 

c 

0 

\-h/ 

sub  ject  t<» 


inf  ^  y,r*  > 

Ar  <  b 
r  r  M,r  >  0, 


where  x  £  X  has  the  form 


All  the  inequalities  should  be  interpreted  with  respect  to  the  positive  cones.  It  is  in¬ 
teresting  that  with  the  above  definitions,  (OPT)  looks  very  much  like  a  standard  linear 
programming  problem,  with  the  exception  that  the  nmnber  of  variables  and  constraints 
is  infinite. 

The  Lagrange  multiplier  is  an  element  inside  Z* ,  the  dual  space  of  Z  which  can  be 
identified  as;  Z*  =  IR"*  x  IR*  x  IR*  x  cj  x  cj.  (Here  we  have  assumed  that  Z  is  equipped 
with  the  weak*  topology,  not  the  norm  topology.)  The  dual  cone  again  consists  of 
the  nonnegative  elements  in  Z*.  The  Lagrangian  can  be  defined  as 

L{x,  z*)  =  {<  x,c*  >  +  <  Ax  -  b,2*  >} 

=  {<  x,c*  +  A*z*  >  -  <b,z*  >} 

where  A*  :  Z*  X*  is  the  adjoint  operator  of  A.  From  the  theory  of  Lagrange 
multipliers  [43],  the  minimum  solution  can  be  obtained  by  performing  an  unconstrained 
minimization  of  L,  i.e., 

fio  =  sup  inf{<  x,c*  -f  A*z*  >  -  <  b,  z*  >} 

j.>OX>0 

Clearly  for  /to  to  be  finite,  i.e  /to  >  — oo,  c*  +  A*  z*  >  0  and  hence  the  above  infimization 
is  achieved  for  a:  =  0.  This  gives  a  dual  formulation  of  (OPT)  summarized  as; 

/to  =  sup  <  b,-z*  >  subject  to  c*  -f  A*z*  >  0  {DOPT). 

*•>0 

To  evaluate  this  explicitly,  let  A*,  z*  be  given  by: 

/AT-  V  V  C- 

A*  ^  \  M*  -V*  V*  -C*  C*  I 
\-e^  0  0  n  0  / 

By  direct  substitution,  (DOPT)  is  converted  to 

//o  ^  sup  <  -  02  >  +  <  62, /3l  -  /32  > 

subject  to 

U*r^  4  V(o,  02)  4  C*(lh  -  /32)  >  0 
V*(«,  -02)  -C*(/3,  -/32)  >  0 

tn 

1=1 

>  0. 


''  V  ^ 

ai 

tt2 

I3i 

\02  / 


.34 


Finally,  substituting  a  =  oi  -  02  and  -  /32  we  get 


/io  =  sup  <  6i,a  >  +  <  h2,fi  > 

subject  to 

-  <  V*a  +  C*0  <  AT^tj 

m 

XI  ^  ^  0 

»=1 

a  e  IR*,  y9  e  cj. 


{DOPT) 


This  dual  formulation  sheds  a  new  light  on  the  optimization  problem.  In  our  context, 
it  will  provide  two  important  results:  the  existence  of  finite-dimensional  duals  for  specific 
classes  of  problems,  and  the  ability  to  construct  suboptimal  solutions  that  are  within  a 
prescribed  e  from  the  actual  minimum. 

Comment:  The  computation  of  the  adjoint  operators  is  quite  simple  once  the  operators 
are  already  constructed.  Recall  that  V  =  VooW;  hence  the  adjoint  operator  V*  = 
Similarly,  C*  =  W~^T^.  Matrix  representations  of  the  operator  M  and  its 
adjoint  are  obtained  in  a  similar  fashion. 


2.8.4  Exact  Solutions  for  a  Class  of  Problems 

Let  the  space  S  be  characterized  solely  by  interpolation  conditions.  This  »•'  the  situation 
when  both  and  T3  have  full  row  rank  and  column  rank  respectively.  In  this  case  C  =  0 
and  62  =  0-  The  dual  problem  (DOPT)  involves  only  a  finite  number  of  variables  and 
thus  it  is  a  finite-dimensional  problem.  The  constraints  however  are  infinite.  Since  the 
elements  of  V*  were  constructed  from  zeros  inside  the  unit  disc,  the  entries  will  eventually 
decay  and  only  a  finite  number  of  the  constraints  are  active.  A  bound  on  the  number  of 
such  constraints  can  be  derived  [10].  The  problem  is  now  a  standard  finite- dimensional 
linear  progreun,  which  can  be  solved  exactly.  The  solution  to  the  primal  problem  (OPT) 
can  be  constructed  either  by  the  alignment  conditions,  or  by  observing  that  the  dual  of 
(DOPT)  is  exactly  the  primal  problem. 

2.8.5  Approximation 

In  the  sequel,  we  will  assume  that  CTt  =  62  is  a  finite  impulse  response  sequence.  This 
condition  is  equivalent  to  saying  that  there  exists  a  FIR  feasible  solution  for  (OPT).  If 
this  condition  is  not  satisfied,  then  the  problem  can  be  modified  so  that  the  condition 
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will  hold  [11,  44).  Upper  approximations  of  fig  can  be  readily  obtained  from  the  primal 
problem.  Define  /ijv  as  follows: 

flf/  —  min/t 

subject  to 

-  fie  <  0 
-  $*)  =  bi 

=  h 

<t>h{k),<Plik)>0 

<i>h(k)  =  0,  (i>^^(k)  =  OV*  >  TV. 

Since  C  is  constructed  from  FIR  sequences,  this  optimization  will  involve  a  finite  number 
of  variables  eind  a  finite  number  of  constraints.  It  is  evident  that  fiff  is  a  non-increasing 
sequence  satisfying  /to  <  fiN  for  all  TV.  Also,  since  a  feasible  FIR  solution  exists,  then 
pN  is  finite  for  TV  large  enough.  Since  FIR  solutions  are  dense,  it  follows  that  ps  — »  /to 
as  TV  — »  oo.  For  each  p^  a  solution  for  the  primal  problem  can  be  constructed.  The 
difficulty  with  this  procedure  is  that  it  is  not  clear  how  far  the  solution  is  from  optimal  at 
any  given  TV.  This  will  be  overcome  by  presenting  lower  approximations  of  the  problem. 

It  is  interesting  to  notice  that  the  dual  of  this  problem  is  obtained  through  truncating 
the  constraints  of  the  dual  problem  (DOPT).  Another  approximation  obtained  from  the 
dual  problem  can  be  obtained  by  truncating  the  variables  /3  G  cj  [5,  55).  Define  /£^  as 
follows: 

/£^  max  <  f>i,n  >  +  <  62,/?  > 

subject  to 

-  A^*r;  <  Va  +  C*l3  < 

in 

X]  V  >  0 

i.-l 

a  G  IR\  G  eg,  f3(k)  OVit  >  N. 

It  is  evident  that  <  /<o  and  that  //^  ‘  /lo  as  TV  —»  00.  The  former  assertion  is  due 

to  the  fact  that  the  new  problem  has  fewer  degrees  of  freedom,  and  the  later  is  due  to 
the  fact  that  finite  sequences  are  dense  in  co.  The  above  problem  is  not  immediately 
a  finite-dimensional  problem — the  constraints  due  to  the  operator  V*  are  still  infinite; 
however,  only  a  finite  subset  of  these  are  active  as  it  was  in  the  case  where  C  was  equal 


to  0.  A  complete  discussion  of  the  computation  of  this  problem  is  given  in  [55].  Clearly, 
there  is  no  feasible  solution  for  the  primal  problem  for  any  of  the 

2.8.6  Computations 

In  the  case  where  C  =  0,  the  li  minimization  problem  is  solved  exactly.  In  all  other  cases, 
only  approximate  solutions  are  obtained  through  obtaining  upper  and  lower  approxima¬ 
tions  of  po-  The  major  computational  burden  is  in  fact  obtaining  the  operator  V,  since 
it  requires  the  computation  of  the  zeros  of  721,  T31  and  their  multiplicities.  Work  on  the 
computational  aspect  of  this  problem  is  in  progress  [24]. 

To  obtain  fast  solutions  that  do  not  necessarily  capture  the  structure  of  this  problem, 
one  can  follow  the  approach  in  [3]  in  which  one  seeks  direct  FIR  solutions  for  Q.  This 
problem  can  be  posed  as  a  linear  programming  problem  which  can  approximate  the 
actual  solution  arbitrarily  closely.  However,  unless  one  invokes  duality,  the  difference 
between  the  approximate  and  actual  value  of  /to  remains  unknown. 

It  is  interesting  to  note  that  exact  solutions  for  special  problems  with  C  ^  0  have  been 
constructed  in  [54].  Although  existence  of  -optimal  solutions  is  guaranteed  (under  mild 
conditions,  namely  no  interpolations  on  the  unit  circle),  it  is  not  known  whether  these 
solutions  are  rational  or  not.  If  C  =  0  optimal  solutions  are  FIR,  and  hence  rational. 
The  general  case  is  still  an  active  area  of  research. 

2.9  Conclusions 

This  chapter  gives  an  overview  of  the  problem  of  synthesizing  optimal  controllers  to 
deliver  performance  specifications  in  the  time  domain,  in  the  presence  of  bounded  but 
unknown  exogenous  inputs.  A  general  framework  for  the  robust  performance  problem  is 
presented  from  which  necessary  and  sufficient  conditions  are  derived.  These  conditions 
were  related  to  the  spectral  radius  of  a  matrix  constructed  from  the  configuration  of 
the  closed-loop  system.  Alternate  equivalent  conditions  are  also  discussed  in  terms  of 
linear  matrix  inequalities.  These  conditions  are  in  turn  used  in  the  synthesis  problem, 
which  requires  the  solution  of  an  optimal  control  problem.  A  solution  of  this  problem 
using  the  duality  theory  of  Lagrange  multipliers  is  used.  This  approach  highlights  in  a 
non-trivial  way  the  relations  between  fi  optimization  problems  for  infinite-dimensional 
systems  and  infinite  linear  programming  problems.  In  fact,  the  solutions  presented  ex- 
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ploit  the  problem  structure  and  do  not  rely  on  some  general  theory  for  solving  infinite 
linear  programming  problems,  since  such  a  theory  does  not  exist. 

This  chapter  discusses  only  discreie-time  problems.  The  interest  in  discrete-time 
systems  stems  from  the  fact  that  most  controllers  these  days  are  digital  controllers  and 
are  Interfaced  with  the  continuous-time  plant  through  A/D  and  D/A  converters.  A  better 
formulation  should  have  a  hybrid  system  consisting  of  both  continuous-  and  discrete-time 
dynamics.  Such  systems  have  recently  received  considerable  attention  from  the  control 
community  and  are  known  as  sampled-data  systems.  A  formulation  of  the  (i  sampled- 
data  problem  can  be  found  in  [1,  25,  36,  53]  in  which  it  is  shown  that  synthesizing  a 
digital  controller  for  a  continuous-tiine  plant  can  be  done  by  solving  a  purely  discrete¬ 
time  problem.  This  motivates  the  earlier  discussion. 

There  are  other  related  problems  that  are  not  discussed  in  this  chapter.  The  problem 
of  designing  controllers  for  tracking  a  specific  trajectory  is  an  important  problem  and  was 
solved  in  (12).  The  synthesis  approach  has  also  been  extended  for  periodic  and  multi¬ 
rate  sampled  plants  [15].  Also,  this  theory  was  successfully  incorporated  as  part  of  an 
adaptive  control  scheme,  in  which  the  stability  of  the  closed  loop  system  was  guaranteed 
for  a  larger  set  of  plant  uncertainty  [16,  59].  Finally,  a  case-study  for  the  applicability 
of  this  theory  was  reported  in  [13]  in  which  a  contioUei  was  designed  for  a  model  of 
the  A"  -  29  aircraft. 

A  pressing  research  problem  is  the  understanding  of  the  structure  of  the  optimal 
controllers.  Such  an  understanding  will  not  only  add  insight  into  the  problem,  but  will 
also  offer  simpler  ways  of  computing  the  optimal  solution.  This  has  been  the  case  for 
the  Hoo  and  H2  problems.  Some  interesting  results  in  that  direction  are  reported  in 
[54]  in  which  exact  solutions  for  the  infinite-dimensional  linear  programs  arising  in  some 
special  non-square  problems  have  been  computed.  Also,  it  was  shown  in  [23]  that  optimal 
solutions  may  require  a  dynamic  controller  even  though  all  the  states  are  available.  The 
existence  of  some  separation  structure  of  the  (\  problenr  (similar  to  that  of  the  /foo 
problem  [20])  is  still  under  investigation. 

Another  important  research  direction  is  the  synthesis  problem  by  exactly  minimizing 
the  spectral  radius  function,  rather  than  the  iterative  scheme  suggested.  The  iterative 
scheme  is  guaranteed  to  converge  only  to  local  minima  and  hence  there  is  a  need  for 
looking  for  another  approach  for  minimizing  this  function. 

In  this  chapter,  a  comparison  between  the  spectral  radius  function  and  p  is  sketched. 


At  this  point,  it  is  not  known  whether  there  exist  examples  in  which  the  two  methods 
exhibit  extreme  behavior.  Research  in  that  direction  is  currently  in  progress. 
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Chapter  3 


State  Feedback  Optimal 
Controllers  can  be  Dynamic 


This  chapter  considers  -optimal  control  problems  given  by  discrete-time  systems  with 
full  state  feedback,  scalar  control  and  scalar  disturbance.  Motivation  stems  from  the 
central  role  that  this  problem  structure  played  in  the  development  of  the  'Hi  and  “Hoo 
theories.  First,  systems  with  a  scalar  regulated  output  are  studied  (singiilar  problems). 
Sufficient  conditions  are  given,  based  on  the  non-minimum  phase  zeros  of  the  transfer 
function  from  the  control  to  the  regulated  output,  for  the  existence  of  a  static  fj -optimal 
controller.  A  simple  way  to  compute  the  static  gain  is  provided,  using  pole  placement 
ideas.  It  is  shown,  however,  that  having  full  state  information  does  not  prevent  the 
-optimal  controller  from  being  dynamic  in  general,  and  that  examples  with  arbitrarily 
high  order  optimal  controllers  can  be  easily  constructed. 

Second,  problems  with  two  regulated  outputs,  one  of  them  being  the  scalar  control, 
are  considered  (non-singular  problems).  It  is  shown,  by  means  of  a  class  of  fairly  general 
examples  for  which  exact  -optimal  solutions  are  constructed,  that  such  problems  may 
not  have  static  controllers  that  are  -optimal.  Thus  concluding  that  a  “separation 
structure”  does  not  occur  in  these  problems  in  general. 

3.1  Introduction 

Since  Dahleh  and  Pearson  ((10),[11))  presented  the  solution  to  the  li  optimed  control 
problem,  there  has  been  increasing  interest  in  understanding  the  basic  properties  of  such 
problems  ([5], [44],  [45]  and  [54]).  Considering  that  in  the  case  olHi  and  'Hoo  optimization 
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([20], [65]),  state  feedback  optimal  controllers  have  a  very  special  structure  (i.e.  static), 
it  seems  only  natural  to  ask  how  full  state  information  affects  the  optimal  solution. 
In  particular,  under  what  conditions  (if  any)  there  exist  a  static  linear  controller  that 
achieves  optimality.  This  chapter  presents  results  regarding  this  question,  for  systems 
with  scalar  control  and  scalar  disturbance.  In  particular,  two  different  types  of  problems 
within  this  class  of  systems  are  considered:  a)  those  with  a  scalar  regulated  output, 
denoted  as  singular  problems,  and  b)  those  with  two  regiilated  outputs,  denoted  as  non- 
singular  problems,  where  one  of  the  outputs  is  the  scalar  control  signed.  For  systems 
in  a),  it  is  shown  that  there  exists  a  static  controller  which  is  -optimal  if  the  non¬ 
minimum  phase  zeros  of  the  transfer  function  from  the  control  input  to  the  regulated 
output  satisfy  a  simple  algebraic  condition.  Violating  such  condition,  however,  may 
result  in  a  dynamic  -optimal  controUer  of  possibly  high  order  (generally  when  the  non¬ 
minimum  phase  zeros  are  “close”  to  the  unit  circle).  For  systems  in  b),  it  is  shown  by 
means  of  an  example  that  optimal  controllers  are  dynamic  in  a  broad  class  of  cases  which 
are  common  in  control  design.  The  difficulty  in  analyzing  the  non-singular  problem  is 
that  it  is  not  straightforward  to  compute  the  optimal  solution,  as  it  is  the  case  with  a 
singular  (i.e.  square)  one.  For  the  given  non-singular  example,  the  optimal  solution  is 
constructed  and  shown  to  require  a  dynamic  compensator. 

The  chapter  is  organized  as  follows.  Section  2  formulates  the  singular  problem  along 
with  some  basic  notation.  Sections  .3  and  4  present  results  corresponding  to  singular 
problems  involving  minimum  and  non-minimum  phase  plants  respectively.  Section  5 
examines  a  non-singular  problem  by  means  of  a  general  example,  followed  by  the  con¬ 
clusions  in  Section  6. 

3.2  Problem  Formulation 

Consider  the  following  state-space  minimal  realization  of  a  full  state  feedback  system 
with  scalar  input  disturbance,  scalar  control,  scalar  regulated  output: 


1  ^ 

5, 

k? 

\ 

0 

di2 

1  ^ 

0 

0 

where  A  £  IR"’^",  6i  and  62  €  IR"^’,  cj  £  IR*’"',  and  di2  £  IR.  For  any  internally  sta¬ 
bilizing  controller  k,  let  4>  =  {(/i(0), </>(!), ^(2),...}  denote  the  closed-loop  pulse  response 
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sequence  from  the  disturbance  to  the  regulated  output.  Then,  the  problem  can  be  stated 
as  follows: 

ii^  ||<^||i  (3.1) 

where  ||<^||j  l<^(OI'  Using  standard  results  in  the  parameterization  of  all  stabilizing 

controllers  (see  [28]),  problem  (3.1)  can  be  rewritten  as  follows: 

inf  llh  -  u  *  g  ♦  v||i  (3.2) 

/  lx* 

9eti 

where  indicates  the  space  of  all  m  x  n  matrices  with  entries  in  l\  and  *  denotes 

convolution.  Thus,  h  and  u  G  /t»  and  v  6  fi"***.  Let  the  A-transform  of  a  right-sided 
real  sequence  x  =  {i(0),  i(l),*(2),. . .}  be  defined  as 

x{\)=f^x{k)X’^ 

fc=0 

where  A  represents  the  unit  delay.  Then,  a  state-space  realizations  for  h,  u  and  v  can  be 
found  by  using  the  state-space  formulas  in  [28]  with  the  observer  gain  matrix,  H,  equal 
to  -  A.  For  this  specific  choice,  the  realizations  are: 


h(A)  = 

A  (A/,  A  bu  Cl  4-  dnff  cihi] 

(3.3) 

u(A)  = 

(A/,  62, Cl  -1-  di2/,di2] 

(3.4) 

t.(A)  = 

[0,  hi,  7,0]  =  A  61 

(3.5) 

where  h(A),  «(A)  and  t;(A)  denote  the  A-transform  of  /i,  u  and  v;  A  -\-  62  /, 

[A,B,C,D]^^^  \C(I  -  AA)-*  B  +  D 

and  /  is  chosen  so  that  all  the  eigenvalues  of  A/  are  inside  the  rmit  disk. 

The  following  result,  which  will  be  needed  in  the  next  section,  is  proved  in  [10] 

Theorem  3.2.1  Assuming  u(-)  and  i»(-)  have  no  left  and  right  zeros  respectively  on  the 
unit  circle,  there  exists  q^t  €  that  achieves  the  optimal  norm  in  problem  (3.2). 

Moreover,  the  closed-loop  optimal  pulse  response,  =  h-u*q„pt  *v,  has  finite  support. 

3.3  Singular  Problems  with  Minimum-Phase  Plants 

This  section  considers  the  case  where  the  transfer  function  from  the  control  input  to 
the  regulated  output  is  minimum-phase  except  for  an  integer  number  of  unit  delays 
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(i.e.  zeros  at  the  origin  in  the  A-plane).  It  will  be  assumed  throughout  that  {A,  63)  is 
reachable. 

Theorem  3.3.1  For  such  a  system,  the  static  feedback  gain,  /*,  that  places  the  eigen¬ 
values  of  (  j4  +  62  /* )  at  the  exact  location  of  the  minimum-phase  zeros  of  [j4,  63,01,  <£12] 
and  the  rest  at  the  origin  is  fi -optimal. 

Proof.  Consider  using  f*  as  the  state  feedback  gain  in  the  parameterization  described 
above.  Then,  after  carrying  out  all  stable  pole-zero  cancellations, 

«(A)  =  7,  A^ 

where  r  is  the  number  of  unit  delays  in  [j4,  63,01,  <£13]  and  jr  is  a  scalar  depending  on  r. 
In  what  follows,  the  cases  where  r  =  0  and  r  >  0  will  be  treated  separately. 

i)  If  r  =  0,  then  <£12  0,  Oi  -|-  <£12  /*  =  0,  and  ti(A)  =  <£13.  Also,  from  equation  (3), 

h(A)  =  oi  61  A  =  (ci6i  -I-  <£i2r6i  -  duf*b^)^  =  -di2/*6i 
<^(A)  =  -d,2r6iA  -  di29(A)6iA 

Thus,  the  fi-optimal  solution  is  given  by  qopt(A)  =  -/*,  and  =  0.  Furthermore, 

using  the  state-space  equations  in  (28|  for  computing  the  optimal  controller,  it  can  be 
shown  after  a  little  algebra  that  Jfeop«(A)  =  /*- 

ii)  If  r  >  0,  then  (£12  =  0,  OiA^.  =  0  by  construction  since  (4,63)  is  reachable.  Also 
u(A)  =  Cl  A^7^62  A’’.  Again,  from  equation  3, 

h(A)  =  C161A  -I-  Cl  A6iA2  +  Cl  A/.A6iA=’  ciA}7M6iA’-+^ 

Therefore,  the  closed-loop  pulse  response  is  given  by 

0(  A)  —  ci6|A-|“CiA6iA^-i-ciA_^.A6iA'-l-*'’ 

-f-  oiA}7''6iA"  -h  ciA;^7'(A  -  62g(A))6iA"+i 

Clearly,  q  does  not  affect  the  first  r  -t-  I  elements  of  (i.e.  <{>{(), i  =  0,1,..., r).  Then, 
the  best  possible  choice  of  g,  in  the  sense  of  minimizing  the  fi-norm  of  <^,  is  the  one  that 
makes  <f>{i)  =  0  for  i  =  r  -f-  1,  r  4  2, . . .,  and  is  achieved  by  letting  gopt(A)  =  -/*,  since 
^(r  4-  1)  =  Cl  Ay.  61  =  0.  Again,  the  corresponding  fi -optimal  controller  is  /*.  I 
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Corollary  3.3.1  The  -optimal  closed-loop  transfer  function  of  the  system  considered 
in  Theorem  3.3.1  (with  r  >  Q)  is  given  by: 

r 

t=i 

Proof.  It  follows  from  the  fact  that  ciA'f,b2  =  0  for  t  =  0, 1, . . . ,  r  -  2.  The  details  are 
left  to  the  reader.  ■ 

Put  in  words,  Theorem  3.3.1  says  that  there  is  nothing  the  controller  can  do  to  invert 
the  delays  in  the  system.  It  can,  however,  cancel  the  rest  of  the  dynamics  of  the  system 
due  to  the  absence  of  non-minimum  phase  zeros  in  the  transfer  function  from  the  control 
input  to  the  regulated  output.  This  results  in  an  optimal  closed-loop  pulse  response  that 
is  equal  to  the  open  loop  pulse  response  in  its  first  (r  -|- 1)  elements  and  zero  thereafter. 
It  is  also  worth  noting  that  Theorem  3.3.1  is  directly  applicable  to  the  discrete-time 
LQR  problem,  where  Yli  i®  minimized.  More  precisely,  the  asymptotic  LQR  solution 
(see  [40])  where  the  weight  on  the  control  tends  to  zero  (i.e.  cheap  control  problem)  is 
identical  to  that  of  Theorem  3.3.1. 

3.4  Singular  Problems  with  Non-minimum  Phase  Plants 

This  section  considers  those  cases  where  [^4, 621  Cj,  djj)  ^  non-minimum  phase  zeros 
not  necessarily  at  the  origin  (i.e.  X  =  0). 

Again,  we  use  the  same  parameterization  as  in  the  previous  section.  That  is,  we 
choose  /*  to  place  (n  -  r)  eigenvalues  of  A*^  at  the  exact  location  of  the  minimum  phase 
zeros  of  (A,  62,  Ci,  di2]  the  rest  (r)  at  the  origin.  Then,  from  the  discussion  in  section 
3,  h{X)  is  polynomial  in  X  and  of  order  (r  +  1),  w(A)  is  polynomial  too,  but  of  order  r, 
and  i)(A)  is  simply  A  61.  Therefore,  the  closed-loop  transfer  function  can  be  written  as 
follows: 

<^(A)=  a1^^^(A)A  (3.6) 

where  gi,g2  6  IR,  Oj’s  are  the  zeros  of  h,  /J^’s  are  the  (non-minimum  phase)  zeros  of 
u  and  [A,b2,Ci,dn],  and  ^(A)  g(A)6,  e  fi.  Note  that  ||<^||,  =  ||<^||j.  Also,  by 

Theorem  3.2.1,  ^opdX)  is  polynomial  in  A,  which  implies  that  polynomial  in 
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A.  Thus,  the  optimization  problem  is  equivalent  to  the  following  linear  progranuning 
(primal)  problem:  for  a  sufficiently  large  but  finite  s, 

(3-7) 

^  i=0 

»  r 

s.t.  =  3i  f[(/3j  -  Oi)  ,  j  =  l,2,...,r 

«=o  t=l 

In  the  above  we  have  assumed  that  the  /9j’s  are  simple  zeros  to  simplify  the  formulation 
of  the  interpolation  conditions.  The  following  results,  however,  carry  over  to  the  more 
general  case. 

The  following  theorem  by  Deodhare  and  Vidyasagar  [17]  will  prove  useful.  It  is  stated 
with  no  proof. 

Theorem  3.4.1  The  support  of  ^  in  (3.7),  denoted  as  (s  +  1),  equals  the  number  of 
constraints  r,  if 

EKI<1  (3.8) 

1=0 

where  nj=i(-^  "  ^j)  =  +  Or-iA’’”*  + - h  oiA  +  oq. 

Now  we  are  ready  to  present  the  next  result. 

Theorem  3.4.2  Let  [A,b2,ci,di2]  have  r  non-minimum  phase  zeros,  then  if  (3.8)  is 
satisfied,  f*  is  f i  -optimal. 

Proof.  By  Theorem  3.4.1,  <^op,(A)  is  of  order  (r  -  1).  Then,  considering  the  order  of 
each  term  in  (3.6),  it  is  clear  that  q^t(^)  has  to  be  constant  and  such  that  <^(r)  =  0. 
Using  the  state-space  formulas  (3),  (4)  and  (5), 

0  =  <^(r)  =  (cr-i-dj2r)A}7^(Abi-h2q,^c(0)) 

=  (cj  1  </i2 /*)i4y, ’(d  —  62  gop((0))5i 

But,  by  construction,  (ci  -I-  d^2/*)Ay.  =  0  due  to  the  stable  pole-zero  cancellations  and 
the  fact  that  the  rest  of  the  poles  are  placed  at  the  origin.  Therefore,  qopt  =  -/*  is  the 
required  value,  and  k„pt  =  /*.  I 

Observation:  It  remains  to  consider  those  cases  where  the  non-minimum  phase  zeros 
of  [i4, 62,ci,di2]  are  such  that  they  violate  condition  (3.8).  Theorem  3.4.1  established  a 
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sufficient  condition  to  determine  the  order  of  the  optimal  response.  If  (3.8)  is  violated, 
the  optimal  closed-loop  response  may  be  of  higher  order,  possibly  greater  than  n,  but 
still  polynomial.  If  that  is  the  case,  then  the  -optimal  controller  is  necessarily  dynamic, 
since  the  highest  order  polynomial  response  that  a  static  controller  can  generate  is  n  by 
placing  all  closed-loop  poles  of  the  plant  at  the  origin.  Any  polynomial  response  of  order 
greater  them  n,  say  N,  requires  a  dynamic  compensator  of  at  least  order  N  -  n.  Thus, 
Si=o  l“»l  —  1  viewed  as  a  necessary  condition  for  the  optimal  controller  to  be 

dynamic. 

The  following  example  shows  that  a  large  class  of  state  feedback  singular  problems 
have  this  property. 

Example  1:  Consider  the  following  parameterized  family  of  plants  (with  parameter 

k), 

p  ^ _ A(aA^-2.5A-H) 

^  (1  -  0.2A)(23A2  -  2.5A  -f-  1) 

Assume  that  the  controller  has  access  to  the  state  vector  and  that  the  disturbance  acts 
at  the  plant  input.  The  non-minimum  phase  zeros  relevant  to  this  theory  are  given  by 
the  roots  of  kA^  -  2.5A  1,  as  a  function  of  k.  It  is  easy  to  see  that  for  k  >  3.5  condition 

(3.8)  is  satisfied  and  the  optimal  controller  is  /*.  By  applying  the  methods  of  [10],  it 
can  be  shown  that  for  k  =  3.5  the  optimal  solution  is  no  longer  tinique.  Actually  two 
possible  solutions  with  ||<Aop<||j  =  7  are: 

7  _  I  ^  -  2.5A2  -t-  3.5A^ 

\  A  -  1.1A2-|-4.9A‘‘ 

The  first  is  achieved  with  /*  while  the  second  requires  a  first  order  controller.  (The 
non-uniqueness  is  related  to  the  occurrence  of  weakly  redimdant  constrmnts  in  the  linear 
program.)  Note  that  for  this  value  of  k,  the  left  hand  side  of  (3.8)  is  equal  to  one. 

For  1.5  <  K  <  3.5  condition  (3.8)  is  violated  and  the  optimal  solution  has  the  following 
general  form: 

As  K  \  1.5,  one  of  the  non-minimum  phase  zeros  approaches  the  boundary  of  the  unit 
disk  while  <^«(2)  — *  -1.5,  0«(Nk)  — *  0.5,  and,  most  remarkably,  oo.  T'’is 

implies  that  the  optimal  controller  can  have  arbitrarily  large  order.  For  instance,  if 
K  =  1.51,  then 

~  A  -  1.4907A='  4  0.5776A’2 
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and  the  optimal  compensator  is  of  order  9.  It  is  also  interesting  to  point  out  that  for 
K  <  1.5  one  of  the  non-minimum  phase  zeros  leaves  the  unit  disk  and  condition  (3.8)  is 
again  satisfied.  In  this  case,  ^ope„<, »  =  “  1.5A^  and  kopt  =  /*•  With  regard  to  the 

optimal  norm,  it  drops  from  a  value  arbitrarily  close  but  greater  than  3  to  a  value  of  2.5 
in  the  transition. 

Similar  behavior  has  been  reported  in  [46],  for  the  case  of  sensitivity  minimization 
through  output  feedback.  The  above  example  shows  that  the  nature  of  such  solutions 
have  comparable  characteristics  even  under  full  state  feedback.  There  is  one  difference, 
however,  which  reflects  the  structure  added  to  the  problem.  In  [46]  a  pareimeterized 
family  of  first  order  systems  was  constructed  with  arbitrarily  high  order  optimal  con¬ 
trollers,  while  this  setup  requires  at  least  a  second  order  plant  with  two  non-minimum 
phase  zeros  away  from  the  origin.  Note  that  condition  (3.8)  is  automatically  satisfied 
otherwise. 

3.5  A  Non-Singular  Problem 

So  far  we  have  considered  problems  with  a  scalar  regulated  output.  One  could  argue  that 
sensitivity  minimization  problems,  such  as  the  one  in  the  above  example,  where  a  measure 
of  the  control  effort  is  not  included  in  the  cost  functional  (i.e.  singular  problems),  may 
have  peculiar  solutions  that  could  hide  the  structure  of  the  more  general  non-singular 
case.  To  clarify  this  point,  we  will  consider  a  variation  of  the  above  example  by  including 
the  control  effort  in  the  cost  functional.  That  is, 

'•  =  ",  (3.9) 

where  <f>i  represents  the  closed- loop  map  from  the  disturbance  to  the  output  of  the  plant, 
<t>2  represents  the  closed-loop  map  from  the  disturbance  to  the  control  input,  and  7  is  a 
positive  scalar  weight.  The  fact  that  there  are  two  regulated  outputs  and  only  a  scalar 
control  makes  this  problem  of  the  bad  rank  class  (i.e.  two-block  column  problem,  see  [11] 
and  [44]).  This  implies  that  a  linear  programming  formulation  of  the  solution  will  have, 
in  general,  an  infinite  number  of  non-zero  variables  and  active  constraints  (Theorem 
3.2.1  no  longer  holds)  making  the  construction  of  exact  solutions  a  non  trivial  task.  For 
the  following  example,  however,  it  is  shown  that  the  optimal  response  has  finite  support, 
and  that  an  exact  solution  can  be  computed  by  the  methods  in  [54]  and  [24]. 


47 


Example  2:  Consider  problem  (3.9)  for  the  pcirameterized  family  of  plants  of  Ex¬ 
ample  1.  By  expsmding  each  term,  Equation  3.9  can  be  rewritten  as: 


inf  Ilf  ) 


♦  g  +  uji 


(3.10) 


where,  according  to  the  previous  parameterization  (and  using  the  same  notation). 


hi{X)  =  A[f4/.,  i46i,ci -I- di2/*,ci6i] 

MA)  =  A[Ay.,A6i,/',0] 

+  dl2/*,di2] 

“2('^)  =  [^/•»^25 /*»  1] 

u(A)  =  A6i 


(3.11) 


With  the  particular  problem  data  and  /c  =  2,  u(A)  has  a  right  zero  at  the  origin  and 
(ui(A)  7£i2(A))^  has  no  left  zeros.  Then,  the  optimization  problem  can  be  posed  in  the 
primal  space,  /i,  as  follows  ([11]): 


subject  to: 


MO)  =  0 

«J^2(0)  =  0 

{U2  *  <i>i  -  Ui  *  Mi^)  =  (m2  *  hi  -  Ui  * /i2)(fc),  A;  =  0,1,2,... 
Or  in  the  dual  space,  (ooi  as 


fl  =  sup  ^  «(  j)(?f2  *  hi  -  Ui  ♦  /l2)(i) 

.fj  ,  -  0 


subject  to: 


(3.12) 


(3.13) 


(3.14) 


|(y:,^o«(»  +  ^)«2(0)+(0'^)/3i|  <  ri 

I(E:^o«(*  + ^)«i(0)- (0'^)/^2l  <  ^2  (3.15) 

Ti  f  r2  <  1 

for  fc  =  0, 1, 2, . . .,  where  a  €  foo  and  /3i,/32, ti,  T2  6  IR. 

Let  /Zyv  denote  the  value  of  (3.12)  when  the  constraints  <^,(ib)  =  0  for  all  Jfc  >  iV,  i  =  1, 2 
are  appended  to  (3.13),  and  let  denote  ..he  value  of  (3.14)  when  the  constraints 
a{k)  =  0  for  all  A  >  M  are  appended  to  (3.15).  Then,  clearly 


<  n  <  fiN 


(3.16) 
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for  all  positive  integers  M  and  N.  We  will  refer  to  these  problems  as  the  truncated  primal 
and  the  truncated  dual  problem  respectively.  Next,  let  7  =  0.1,  iV  =  5  and  M  =  13,  then 
the  following  are  exact  solutions  to  the  truncated  primal  and  truncated  dual  problems 
(within  15  digits  accuracy): 


A  - 

998.6  \  ,  11895.4  \2  i  8965. 
- SrS"''  T - kk5  f  KK* 


4;^3  ^  1282.2  ^^4  _  708.4^6 
558  558 


(3.17) 


0.970131421744327 

0.0298685782556741 

18.1617920759050 

42.7538829151732 

0 

37.7844820452347 

-3.29789187316069 

-1.65259869560944 

-0.401868143803625 

0.309029878922354 

0.572287131426917 

0.545909685694633 

0.411177830532670 

0.255951734446358 

0.129285041919450 

0.0273249362257737 

-0.0155520615496705 

-0.0181682559221378 

0 


(3.18) 


It  is  easy  to  verify  using  the  values  in  (3.17)  and  (3.18)  that  =  1192/279  ~ 

4.2724,  thus,  from  (3.16),  p  =  1192/279  and  (3.17)  is  the  exact  solution  to  the  full  primal 
problem  (3.12).  Therefore,  since  such  solution  has  finite  support  and  is  of  fifth  order, 
the  optimal  controller  is  necessarilly  dynamic  and  of  second  order.  Also  note  that  the 
optimal  closed  loop  response  is  such  that  j|<^i||i  =  ylld*?!!  =  /«• 

It  is  also  interesting  to  consider  the  singular  problem  corresponding  to  this  example 
(i.e.  K  =  2  £md  7  =  0).  The  optimal  solution  (which  is  obtained  by  eliminating  the 
second  row  and  solving  the  resulting  good  rank  problem)  is  given  by: 


MX)  =  -it^A+l||5A2  4-l^A3  +  ilf6A4_2mA« 
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where  ||^i||i  =  286/68  ~  4.2059  while  )|^2|li  =  4374.4/68  ^  64.3294  is  clearly  larger 
since  it  was  left  out  of  the  optimization.  In  fact,  the  above  solution  is  valid  for  7  € 
[0,286/4374.4]  since  for  any  7  in  such  interval  ||^i||i  >  7||^2|li-  Moreover,  for  any 
such  7,  the  /i -optimal  controller  is  dynamic  and  of  second  order  since  the  optimal  <i>\  is 
polynomial  and  of  fifth  order.  This  alone  constitutes  a  family  of  problems,  parameterized 
by  7  e  [0, 286/4374.4],  requiring  dynamic  optimal  controllers. 

All  this  indicates  that  given  a  non- singular  (two-block)  problem,  the  optimal  con¬ 
troller  may  very  well  be  dynamic,  whether  or  not  the  two  regulated  outputs  impose 
conflicting  goals  (i.e.  active  constraints).  Further,  it  can  be  shown  that  even  when  the 
corresponding  singular  problem  has  a  static  optimal  controller,  the  non-singular  prob¬ 
lem  may  require  a  dynamic  one.  This  will  happen  only  if  7  is  large  enough  to  make  the 
second  row  of  the  cost  functional  active  in  the  optimization. 

A  last  question  remains  to  be  answer:  given  a  full-state  feedback  problem  with  a 
dynamic  -optimal  controller,  is  it  possible  to  find  a  static  controller  that  achieves  an 
^i-norm  arbitrarily  close  to  the  optimal?  Again,  it  is  easy  to  show  via  a  counter  example 
(numerical)  that  this  is  not  the  case.  In  fact,  a  simple  second  order  problem  can  show 
that  the  gap  between  the  norms  achieved  by  the  optimal  and  the  static-optimal  controller 
can  be  significant. 

3.6  Concluding  Remarks 

This  chapter  presented  a  study  of  the  fj  optimization  problem  for  systems  with  full 
state  feedback,  scalar  disturbance  and  scalar  control.  Two  classes  of  problems  were 
considered:  a)  singular  problems  with  a  scalar  regulated  output,  and  b)  non-singular 
two-block  problems  with  two  regulated  outputs,  one  of  them  being  the  control  sequence. 
The  main  purpose  of  the  study  was  to  determine  whether  or  not  there  is  always  a  static 
controller  which  is  -optimal.  In  the  case  of  singular  problems,  a  sufficient  condition  was 
given,  based  on  the  non-minimum  phase  zeros  of  the  transfer  function  from  the  control 
to  the  regulated  output,  for  the  existence  of  a  static  -optimal  controller.  The  optimal 
gain  is  such  that  it  places  a  subset  of  the  closed-loop  poles  at  the  exact  location  oi 
the  minimum  phase  zeros  of  the  transfer  function  from  the  disturbance  to  the  regulated 
output  and  the  rest  at  the  origin.  Then,  it  was  shown  by  means  of  general  examples,  that 
both  singular  as  well  as  non-singular  problems  may  require  dynamic  optimal  controllers 
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of  arbitrOTily  high  order,  in  spite  of  the  perfect  state  information.  This  adds  to  the 
observations  made  in  [46]  where  singular  problems  with  output  feedback  were  considered. 
In  fact,  it  can  be  shown  using  similar  arguments  that  full  information  problems  (where 
the  disturbance  is  meastired  exactly)  also  have  these  characteristics. 

Although  the  systems  in  question  were  simple,  it  is  safe  to  conclude  that  more  com¬ 
plex  MIMO  state  feedback  optimization  problems  will  also  have  these  characteristics 
in  general.  Therefore,  it  is  doubtful  that  the  study  of  the  full  state  feedback  problem  wiU 
render  a  “separation  structure”  similar  to  the  ones  found  in  and  Tt,*,  optimization 
theory  ([20],  [65]). 


.51 


Chapter  4 

Rejection  of  Persistent  Bounded 
Disturbances:  Nonlinear 
Controllers 


This  chapter  considers  nonlinear  time-varying  (NLTV)  compensation  for  linear  time- 
invariant  (LTI)  plants  subject  to  persistent  bounded  disturbances.  It  is  shown  using  two 
different  approaches  that  using  NLTV  compensation  instead  of  LTI  compensation  does 
not  improve  the  optimal  rejection  of  persistent  boimded  disturbances.  The  first  approach 
is  to  derive  a  bound  on  the  achievable  performance  over  all  stabilizing  NLTV  controllers. 
Using  results  from  -optimal  control,  it  follows  that  in  some  special  cases  this  bound 
can  be  achieved  by  LTI  compensation.  This  approach  involves  the  introduction  of  an 
operator  analogous  to  the  Hank  el  operator  in  -optimal  control  and  is  of  independent 
interest.  The  second  approach  is  to  assume  the  NLTV  controller  is  sufficiently  smooth 
to  admit  a  time-varying  linearization.  This  time- varying  linearization  is  then  used  to 
construct  an  LTI  controller  which  achieves  the  same  performance  as  the  original  NLTV 
controller.  These  results  extend  previous  work  by  the  authors  regarding  linear  time- 
varying  compensation. 
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Notation 

LTI  :=  linear  time-invariant 
LTV  :=  linear  time-varying 
NLTV  :=  nonlinear  time-varying 

^oo  :=  {/  =  (...,/(-l),/(0),/(l),/(2),...) :  II/IL  ='sup|/(n)|  <  00} 


4.1  Problem  Statement 


In  this  chapter,  we  consider  the  use  of  NLTV  compensation  to  achieve  optimal  distur¬ 
bance  rejection  with  LTI  plants.  This  problem  has  been  considered  in  [2,  27,  37,  39,  51]. 
In  [27,  37,  39],  it  was  shown  that  NLTV  compensation  does  not  improve  the  optimal  rejec¬ 
tion  of  finite-energy  (i.e.,  f*)  disturbances.  In  [51],  it  was  shown  that  LTV  compensation 
does  not  improve  the  optimal  rejection  of  persistent  bounded  (i.e.,  fco)  disturbances. 
This  was  extended  to  continuous-time  systems  in  [2].  Possible  advantages  of  NLTV 
control  are  discussed  in  [38]  and  references  contained  therein. 

The  results  of  [2,  51]  hold  for  LTV  compensation  only.  In  this  chapter,  we  consider 
nonlinear  compenstation  with  persistent  bounded  disturbances.  It  is  shown  using  two 
approaches  that  NLTV  compensation  again  does  not  improve  the  optimal  disturbance 
rejection  of  Igg  disturbances.  The  first  approach  involves  the  introduction  of  an  operator 
analogous  to  the  Hankel  operator  in  Tf^-optimal  control  which  is  of  independent  interest. 
This  operator  leads  to  a  bound  on  the  achievable  performance  which  can  be  achieved  by 
LTI  compensation.  The  second  approach  uses  a  linearization  of  the  nonlinear  controller 
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to  construct  an  LTI  controller  which  achieves  the  same  performance  as  the  original  NLTV 
controller. 

In  the  discussion  that  follows,  familiarity  with  the  disturbemce  rejection  problem 
framework  and  related  notions  of  stabilization,  causality,  and  well-posedness  is  assumed 
(cf.,  [28,  60]).  In  particular,  unless  otherwise  specified,  all  operators  are  norm-bounded 
causal  mappings  over  signals  with  support  (—00,00). 

To  set  up  the  problem,  let  Tz^(K)  denote  the  closed-loop  mapping  from  the  exoge¬ 
nous  disturbances,  tt>,  to  the  regulated  variables,  z,  as  a  function  of  the  controller  K. 
Let  .A/tv  denote  all  norm-bounded  causal  NLTV  operators  on  foo-  Let  Ctv  denote  the 
subset  of  Mtv  which  are  linear.  Similarly,  let  Cti  denote  the  subset  of  Ctv  which  are 
time-invariant.  The  A  transform  of  an  element  H  6  Cti  will  be  denoted  by  H{\).  It  can 
be  shown  (cf.,  [28,  56])  that  the  problem  reduces  to  comparing  the  following  quantities: 


fiPTL  inf  {||Tju,{A')||  :  K  is  any  stabilizing  NLTV  controller} 

fiTV  inf  {(|ri„,(A')||  :  A  is  any  stabilizing  LTV  controller} 

=  M  ||T,  -  T2QT3II. 

fiTl  inf  {||Tju,(A')||  :  K  is  any  stabilizing  LTI  controller} 

=  i^tif  |(Ti  -  r^QTail. 

V€tT/ 

Here,  Ti,2,3  €  Cti  discrete-time  multiple-input /multiple-output  systems  deter¬ 
mined  by  the  discrete-time  LTI  plant  and  disturbance  rejection  problem  under  considera¬ 
tion.  In  the  remainder  of  this  chapter,  any  extra  assumptions  on  ri,2,3  will  be  introduced 
as  needed. 

The  following  theorem  concerns  LTV  compensation: 

Theorem  4.1.1  ([51])  prv  = 

In  this  chapter,  we  show  that  under  certain  conditions  //tvl  =  /‘r/- 
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4.2  Main  Results 

4.2.1  A  Hankel-like  Operator 

In  this  section,  a  Hankel-like  operator  (cf.,  [28])  is  defined  for  general  operators  on  too- 
This  Hankel-like  operator  leads  to  a  lower  bound  on  the  achievable  performance  over 
NLTV  compensators.  In  the  special  case  where  Tj  =  /,  it  is  shown  that  this  bound 
may  be  achieved  by  an  LTI  compensator.  In  this  section,  Ti,2,s  are  assumed  to  be 
single- input /single-output  with  the  exception  of  Example  2.2. 

Let  oi, . . . ,  On,  6i, . . . ,  6m  be  the  zeros  of  the  transfer  fimctions  of  T2  and  T3  respec¬ 
tively  inside  in  the  open  unit  disc.  For  simplicity,  assume  they  are  real  and  distinct.  The 
forthcoming  analysis  still  goes  through  in  the  general  case.  Define  the  functions 

«a>(k)  =  aj*  Vk  <  0,  y  =  l,...,n 

%(k)  =  6j*  Vk  <  0,  j  =  l,...,m 
Let 

U  =  span{uaj} 

V  =  span{vb^} 

U  and  V  are  subspaces  inside  supported  on  the  nonpositive  integers.  Given  any 
operator  H  on  define  a  Hankel-like  operator  as  follows 

T„  lU  JrV  ^ 


«  -I-  r  — ►  n_(w  ♦  He  +  e  *  Hv) 


where  n_  denotes  the  projection  on  the  nonpositive  integers,  *  denotes  convolution,  and 
e  denotes  the  unit  pulse  at  the  origin, 


1,  k  =  0; 
0,  k  /  0. 


In  the  case  of  an  LTI  operator  H,  the  operator  Tg  has  a  simple  representation.  Let 
u  +  V  e  1/  +  V,  then 

n  m 

u  +  W  = 

1  =  1  7  =  1 
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and 


The  following  theorem  establishes  the  connection  between  /'-optimal  control  and  the 
above  Hankel-like  operator. 

Theorem  4.2.1  ([10]) 

fiTi  =  l|rr,l|. 
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It  is  interesting  to  notice  that  when  Q  is  LTI,  one  can  easily  show  that  lirr,||  is  a 
lower  bound  for  fin  as  follows.  Let  #  =  Ti  -  T2QT3  with  impulse  response  <f>  ^  O.  Then 

||$||  =  ||Ti  -  T2(?T3l|  >  sup  ||n_(u*(^*e)  +  n_(e*<^*v)||oo 

ueW,weV,||u  +  v||^<i 

=  lirrJIoc 

This  lower  bound  is  not  valid  in  general  if  Q  6  A/Vv-  This  poses  a  serious  problem 
in  proving  the  general  result  we  desire.  In  the  special  case  where  =  I  (and  hence 
U  =  0),  the  lower  bound  is  valid  and  the  desired  result  can  be  proved.  Of  course  this 
includes  the  case  where  is  stable. 

Theorem  4.2.2  IfT2  =  I  then  ftpfi  =  fin- 

Proof.  For  all  «  €  V  with  ||t;||^  <  1, 

IIT1-QT3II  >  ||n_(Ti  -  t?T3)t;|U 

=  ||n_T,u  -  n_gn_T3t;||oo  =  ||n_Tir|u 

The  above  is  true  since  fsibi)  =  0.  Hence, 

||Ti-QT3||>||rr.||  =  m 

However,  the  lower  bound  is  achieved  by  an  LTI  Q.  I 

While  the  conditions  of  Theorem  2.2  are  not  the  most  general,  there  are  in  fact  some 
interesting  problems  in  which  Tj  has  a  stable  inverse.  Below  are  a  few  examples. 

Example  4.2.1  Weighted  input-sensitivity  minimization  for  a  stable  plant. 
The  map  from  the  reference  input  to  the  input  of  the  plant,  with  a  controller  in  the 
feedback  loop,  is  given  by  Si  =  Wi(/  +  KP)~^W2.  Incorporating  the  peirameterization 
of  all  stabilizing  controllers.  Si  is  given  by 

5,  =  W,{I  -  QP)W2 

Both  Wt  and  W2  are  assumed  to  have  a  stable  inverse.  The  result  above  implies  that 
nonlinear  controllers  will  not  offer  any  advantage  in  tracking  problems  with  stable 


plants.  The  parallel  result  for  output  sensitivity  is  still  open. 


Example  4.2.2  Robust  stability  with  coprime  factor  perturbations.  There  is 
an  important  reason  for  considering  this  example.  Even  though  the  result  we  presented 
earlier  is  for  the  square  case,  it  is  still  valid  for  the  non-square  case,  i.e  for  the  case  where 
Tz  is  a  row  vector.  In  this  example  we  will  sketch  the  proof  of  this  result  in  this  special 
problem.  The  general  non- square  case  follows  in  the  same  way. 

Define  the  following  class  of  plants: 

ft  =  {P\P  =  (iV  -I-  AjKM  -f  Ai)-'  and  ||Ai||  <  1} 

with  Aj  being  bounded  LTV  operators  and  P©  =  NM~^  satisfying  the  Bezout  identity 

(  V  U  \  (  M  -U  \  _  (  I  0\ 

\  N  M  )  \  -N  V  )  ~  \  0  I  ) 

A  sufficient  condition  for  robustly  stabilizing  the  above  family  with  any  NLTV  controller 
is  given  by 

ivS  ||(f  t7)  +  (?[^  M]||<1 

v€Atv 

This  condition  is  also  necessary  if  the  controllers  are  restricted  to  be  linear,  possibly 
time-varying  [5,  51].  The  necessity  of  this  condition  for  NLTV  controllers  is  as  follows. 
First,  the  underlying  notion  of  stability  is  finite-gain  stability  over  c°  rather  than 
Second,  the  operator  Q  is  restricted  to  be  continuous  and  have  pointwise  fading-memory 
[52]. 

We  note  that  the  construction  in  [5,  51,  52]  leads  to  a  construction  of  admissible  LTV 
Ai  such  that  either  of  the  following  conditions  occurs.  The  first  condition  is  that  the 
plant  {N  -|-  A2)(M  -t-  Ai)~^  has  an  internal  cancellation.  That  is,  the  operators  Af  -f-  Ai 
and  N  +  Az  are  no  longer  copriiiie.  This  corresponds  to  an  admissible  plant  which  is  not 
stabilizable.  The  second  is  that  the  admissible  plant  (N  +  A2)(M-f  Ai)“^  is  stabilizable, 
but  not  using  the  particular  Q  with  the  property  ||[V  P]  -t-  Q[7V  M]||  >  1. 

It  turns  out  that  above  infimization  is  achieved  via  a  linear  time- invariant  Q.  Define 
the  subspace  V  (inside  t°°  x  as  follows: 

V  =  {r  =  ^  ^  ^  *’(^)  =  0  Vfc  >  1} 
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Then  for  any  Q  €  Mtv  and  t;  €  V,  it  is  true  that 


\\[V  U]  +  Q[N  MH„  =  ||*||oo  >  N0)| 

Equivalently, 

\\[V  U]  +  Q[N  M]||>supl^ 

-ev  ||w||oo 

which  was  shown  in  [5]  to  be  achieved  by  an  LTI  Q.  The  generalization  to  arbitrary  T3 
follows  in  a  similar  fashion.  ■ 


So  far,  there  does  not  exist  a  general  result  that  proves  or  disproves  the  general 
case  where  T2  does  not  have  a  stable  inverse.  In  the  sequel,  a  smaller  lower  bound  on 
||Ti  -  T2QT3II  is  furnished.  However,  it  is  not  evident  that  there  exists  a  causal  Q  that 
achieves  the  botmd. 


Theorem  4.2.3  Let  T3  =  I.  Then 

flNL  >  sup 

u^U,  u/0 

Proof.  By  direct  computation,  with  u  £  U, 


nrr,n||i 

IHli 


IITi 


TjQII  >  ||(t,-T2(?)/|U  v/ef«(z+),  ||/|U<i 

>  ||u*(ri-T2(?)/||oo  ll«lli<i 

>  ||n_(«*(r, -T2(?)/)|U 

=  ||n_(u*T,/)|u 


This  leads  to 


\\Ti-T2Q\\  >  sup  sup  ||n_(u*Ti/)|| 

||u||,<i.ueM||/|U<i 
=  sup  ||rr,u||i 

||u||i<l,ueZY 
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The  interpretation  of  this  bound  is  as  follows.  Fix  any  /  6  looiZ+),  then  there  exist 
&  Qf  such  that 

\m-TiQf)f\U=  sup  lin_u*Ti/|U 

||u||i<i,ueJ/ 

This  Q y  however  may  very  well  be  a  non-causal  function  of  /,  and  hence  does  not  qualify 
as  a  candidate  solution  for  the  originsd  problem.  A  consequence  of  this  theorem  is  that 
in  the  case  of  a  fixed  input  minimization  [12],  nonlinear  time  varying  compensation  does 
not  improve  the  performance.  This  is  clear  from  the  fact  that  the  above  lower  bound  is 
valid  for  each  /  regardless  of  Q  and  can  be  achieved  with  Q  time-invariant  [12]. 

4.2.2  Linearization 


In  this  section,  we  show  that  the  use  smooth  NLTV  compensation  instead  of  LTI  com¬ 
pensation  does  not  improve  the  achievable  rejection  of  persistent  bounded  disturbances. 
The  systems  Ti,2,3  are  now  assumed  to  be  multi-input /multi-output. 

The  smoothness  condition  in  this  context  is  in  terms  of  the  compensation  being 
linearizable.  The  following  definition  is  adapted  from  [60,  Chapter  7]. 


Definition  4.2.1  An  operator  H  €  A/rv  is  linearizable  if  there  exists  an  linear  oper¬ 
ator  Hi  €  Ctv  so  that 


ll/ILs. 

/yo 


In  this  case,  Hi  is  called  the  linearization  of  H . 


The  main  result  of  this  section  is  as  follows: 

Theorem  4.2.4  Let  p^i  be  defined  as  in  (4.1)  with  the  infimization  being  over  all 
Q  G  Ntv  which  are  linearizable.  Then  pri  ~  Pnl- 

Proof.  Let  Q  E  Mtv  be  lin"  .rizable,  and  let 

\\Ti  -  Tzpr,!!  =  p. 

We  will  show  that  there  exists  a  Q  E  Cji  so  that 

\\Ti  -  T^QT.W  <  ,t. 
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Towards  this  end,  let  Qi  denote  the  linearization  ot  C^.  Then  from  Definition  4.2.1,  given 
any  e  >  0,  there  exists  an  a  >  0  such  that 


\\r,Qm  -  T,QM\\ 

f^o 


Then 


> 


> 


> 


||(Ti  -  T,QT,)t\\ 

l¥0 

(((Ti  -  T^QlT^)/  -  (T2QT3  -  T2QLTs)f\\ 

3Up  -- . .  ..-.-..II- 

II/1L<» 

/yo 

ll(Ti  ^  T^QlTM  IKTiQT,  -  T,Qa,)f\\ 

ii/T!..  ■  ii/ii!.. 

f^o  f^O 

||Ti  -  T^QlTsW  -  e. 


Since  e  is  arbitrary,  it  follows  that 


IIT,  -  T2Q1T3II  <  ,1. 

Upon  applying  Theorem  4.1.1,  there  exists  a  t  £r/  so  that 

||T,  -  Tz^Tnll  <  //. 


The  idea  in  the  proof  of  Theorem  4.2.4  is  first  to  show  that  LTV  compensation  gives 
the  same  performance  as  linearizable  NLTV  roTupensation.  We  then  use  the  results  from 
[51]  to  show  that  LTI  compensation  gives  the  s.ame  performance  as  linearizable  NLTV 
compensation. 

4.3  Concluding  Remarks 

Even  for  the  problem  of  disturbance  rejection,  nonlinear  controllers  can  offer  some  ad¬ 
vantage  as  seen  in  the  following  example.  Let  ;  denote  the  unit  delay  operator.  Let 

r.i 


Ta  =  /,  and  let 


Ti  -  Tag  = 


Q. 


Then  for  any  w  e 

/  «»(«)  \  /{Q^){n)\ 

((Ti  -  T2Q)w){n)  =  I  nj(n  -  1)  j  -  I  (Qw)(n)  )  . 

\to(n-2)/  \(Qw){n)/ 

Given  this  structure,  an  optimal  Q  may  be  constructed  as  follows.  Define 

W{n)  max(ii;(n),  w(n  -  1),  w{n  -  2)), 


w{n)  min(tt>(n),  w{n  -  1),  w{n  -  2)) . 

Then  set 

/in  w  \  nT(Ti)  +  u>(n) 

(<?ArLw)(n)  =  ■ 

It  can  be  shown  that  this  selection  of  Qnl  leads  to  ||Ti  -  T^QslW  ~  1.  This  choice  of 
Q  is  nonlinear.  However,  the  same  norm  can  be  achieved  by  using  the  linear  g  =  0. 
Nevertheless,  the  compensator  Qni  achieves  6e«er  performance  in  the  sense  that  signal- 
by-signal,  the  response  using  Qpfi  is  .smaller  than  using  g  =  0.  That  the  two  choices 
lead  to  the  same  norm  means  there  exists  a  signal  so  that  the  responses  are  the  same 
size.  Note  that  the  choice  of  gyvt  differentiable.  Thus,  the  performance  is  not 

characterized  by  the  small  signal  behavior. 

A  comment  is  in  order  regarding  the  use  of  induced  norms  to  assess  the  performance 
of  nonlinear  feedback  systems.  For  linearizable  systems,  the  overall  performance  is  at 
best  the  “small- signal”  performance.  Thus,  it  seem  natural  that  linear  controllers  would 
perform  as  well  as  linearizable  nonlinear  controllers. 

It  turns  out  that  the  use  of  induced  norms  to  assess  performance  may  be  too  restric¬ 
tive  in  the  presence  of  nonlinear  compensation.  The  reason  is  that  this  definition  requires 
the  ratio  of  the  error -norm  to  the  disturbance  norm  to  be  small  without  regard  to  the 
size  of  the  magnitude  of  the  disturbances.  More  precisely,  it  may  be  that  the  regulated 
variable  is  small  while  the  ratio  of  error-norm  to  disturbance-norm  is  large.  This  leads  to 
questioning  the  utility  of  induced  norms  to  quantify  performance  in  nonlinear  systems. 


r.2 


One  alternative  is  to  consider  the  worst  case  performance  over  a  given  class  of  dis¬ 
turbances.  For  example,  let  W  denote  some  bounded  set  of  disturbances.  Then  define 
the  performance  measure 

^  sup!||T*,„w||. 

w€W 

Such  a  performance  objective  is  particularly  well-suited  to  nonlinear  systems.  It  avoids 
using  induced  norms  and  addresses  directly  the  desired  goal  of  keeping  regulated  variables 
small.  Furthermore,  it  allows  the  class  of  disturbances  to  be  defined  as  desired.  For 
example,  one  may  define  VV  as 

VW  =  |to  6  foo  :  ||w(|  <  Cl  and  ^  |ta(n)l*  <  C2 

This  definition  allows  both  a  magnitude  and  energy  bound  on  the  disturbances  of  interest. 
Such  notions  of  performance  have  been  considered  in  [48,  49]. 

Acknowledgments  The  authors  thank  Paul  Middleton  for  suggesting  the  preceding 
Qnl  example. 
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Chapter  5 


On  Slowly  Varying  Systems:  too 
to  ioo  Performance  and 
Implications  to  Robust  Adaptive 
Control 


In  this  chapter  we  present  a  result  on  the  to  too  performance  of  slowly  time  varying 
systems.  In  particular  we  show  that  the  performance  of  such  systems  cannot  be  much 
worse  than  that  of  the  frozen- time  systems  which  are  time  invariant.  This  result  is  used 
to  characterize  a  class  of  indirect  adaptive  controllers  that  can  stabilize  a  time  invariant 
system  subjected  to  both  parametric  and  foo  to  too  bounded  unstructured  uncertainty. 
Pertaining  to  this  class  of  controllers,  a  particular  r  indirect  adaptive  scheme  is  proposed 
that  provides  the  greatest  upper  bound  on  the  size  of  the  unstructured  uncertainty  for 
which  stability  is  ensured. 

5.1  Introduction 

The  problem  of  controlling  slowly  time- varying  systems  arises  in  many  applications.  The 
main  paradigm  is  in  gain-scheduling  where  the  plant  is  time-varying  and  at  successive 
points  in  time  a  controller  is  designed  to  satisfy  certain  stability  and  performance  speci¬ 
fications  based  on  the  “frozen-time”  system  which  is  time  invariant  (LTI).  Therefore,  the 
resulting  controller  is  itself  time- varying.  However,  it  is  expected  that  if  the  rate  of  time 
variation  is  small  enough  then  the  frozen-time  ,Toperties  carry  on  to  the  overall  time- 


varying  system.  In  other  words,  it  is  expected  that  the  stability  of  “frozen-time”  designs 
will  guarantee  stability  of  the  global  time- varying  system  and  also  that  the  performance 
of  the  global  system  cannot  be  considerably  worse  than  that  of  the  frozen  designs.  As  a 
matter  of  fact,  these  expectations  have  not  only  been  confirmed  in  practice  but  also  in 
theory  by  the  work  of  several  researchers  in  this  area  for  example  [6, 18,  27,  37,  50,  63,  64]. 

In  this  chapter  we  continue  the  work  of  [6]  that  was  centered  at  the  stability  issue 
and  extend  it  to  capture  the  performance  part  in  a  bomided  input  to  bounded  output 
(i.e.  ioo  to  foo)  sense.  We  use  the  input-output  framework  of  [6]  that  allows  infinite¬ 
dimensional  plants  and  controllers.  Hence,  the  need  of  a  fixed  degree  is  not  apparent. 
The  main  result  of  this  chapter  is  given  for  single-input  single-output  (SISO)  discrete 
slowly  varying  systems.  It  states  that  the  foo  to  too  performance  of  the  global  time 
varying  system  cannot  be  much  worse  than  the  worst  frozen-time  (go  to  tgo  performance 
given  that  the  rates  of  variation  of  the  plant  and  the  controller  are  sufficiently  small. 
Moreover,  given  the  continuity  properties  of  the  optimal  ti  design  established  in  [7]  it 
follows  that  optimal  ti  [10,  11]  frozen-time  design  yields  an  upper  bound  on  the  too  to  too 
p  performance  of  the  global  system.  Our  main  result  is  in  parallel  with  these  in  [63,  64] 
however  our  derivation  is  more  direct  and  suited  to  the  too  to  too  disturbance  rejection. 

An  important  application  of  our  main  result  is  in  robust  adaptive  control.  In  particu¬ 
lar  we  characterize  a  class  of  indirect  adaptive  controllers  that  can  stabilize  systems  that 
contain  both  parametric  and  unstructured  uncertainty.  The  unstructured  uncertainty 
enters  the  system  in  the  form  of  bounded-input,  bounded-output  operators  perturbing 
the  coprime  factors  of  the  plant.  This  class  of  stabilizing  controllers  is  obtained  by 
frozen-time  controllers  that  stabilize  the  estimated  models  at  each  time  of  the  plant. 
The  estimated  model  is  obtained  via  a  parameter  estimation  algorithm  which  produces 
slowly  varying  estimates.  The  conclusion  is  that  if  the  frozen  time  designs  stabilize  the 
estimated  model  together  with  the  tinstructured  uncertainty  (possibly  after  some  initial 
transient  period)  then  stability  of  the  adaptive  scheme  is  guaranteed.  This  result  is  sim¬ 
ilar  to  the  one  reported  in  [41]  where  the  auhtors  use  a  continuous  time  framework  and 
a  different  characterization  of  the  size  of  the  uncertainty.  Finally,  among  this  class  of 
controllers  we  present  a  particular  a<laptive  scheme  that  requires  for  stability  the  least 


conservative  bound  on  the  to  (go  “gain”  of  the  unstructured  perturbations.  This 
scheme  is  a  modification  of  the  (i  adaptive  scheme  found  in  [7]. 

5.2  Preliminary  Definitions 

In  this  chapter  the  following  notation  is  used: 

|ar|2  :  The  Euclidian  norm  of  the  finite  dimensional  real  vector  x. 

W[A]  :  The  maximum  singular  value  of  the  matrix  A. 

fimxn  •  The  normed  linear  space  of  all  mxn  matrices  H  each  of  whose  entries  is  a  right 
sided,  absolutely  summable  real  sequence  Hij  =  The  norm  is  defined  as: 

ll^ll^  =max^f;|jy,,(I:)| 

'■Imxn  t  ‘  ' 

j=l  k=0 

:  The  normed  linear  space  of  all  m  x  n  matrices  H  each  of  whose  entries  is  a  right 
sided,  magnitude  bounded  real  sequence  Hij  =  {Hij(k))^_Q.  The  norm  is  defined  as: 

m 

^  1U 
»=1  ^  ^ 

:  The  subspace  of  consisting  of  all  elements  which  converge  to  zero. 

:  The  space  of  real  m  x  1  vectors  u  each  of  whose  components  is  a  magnitude  bounded 
real  sequence  (ui{k))f^_Q.  The  norm  is  defined  as: 

||w|L.«.  =  max(siip  |u,(I-)|) 

*• 

;  The  space  of  real  m  x  1  vector  valued  sequences. 

H{^)  :  The  A-transform  of  a  right  sided  in  x  n  real  sequence  H  —  {H{k))'^g  defined  as: 

H{\)  V  I{{k)\''- 

k  o 


Amxn  '  The  real  normed  linear  spare  of  all  m  x  v  iiuifrires  //(A)  so  that  ^(A)  is  the 


A-transform  of  an  fi„,xn  sequence  H.  This  space  is  isoinetrically  isomorphic  to  fi^xn- 
:  The  space  of  all  linear  bounded  and  causal  maps  from  loon  to  foom-  We  refer  to 
these  operators  as  stable. 

:  The  subspace  of  consisting  of  the  maps  that  commute  with  the  shift 

operator  (i.e.  the  time  invariant  maps).  This  space  is  isometrically  isomorphic  to  Amxn- 
njj,  :  The  A;‘^-truncation  operator  on  defined  as: 

{«(0),u(l),...}  — ►  {u(0),...,u(A:),0,0,...} 

Am  :  The  right  shift  operator  on  i.e. 

Am  :  {a(0),a(l),...}  — »  {0,a(0),a(l), . . .} 


Note:  We  will  often  drop  the  m  and  n  in  the  above  notation  when  the  dimension  is 
not  important  or  when  it  is  clear  from  the  context.  Also,  subscripts  on  the  norms  are 
dropped  when  there  is  no  ambiguity. 


Let  T  be  an  operator  in  Crr  with  transform  representation 

OO 

r(A).  X^TIOA'. 

i-O 

Definition  6.2.1  The  Integral  Time  Absolute  Error  ITAE  associated  with  T  is  defined 
as 

OO 

/TAt;(T) 

If  T'  is  the  LTI  operator  associated  with  the  derivative  T'(  A)  =  then  it  follows  that 

iTAE(r)  =■•  iiri|. 

Given  a  sequence  of  LTI  operators  {  where  each  At  is  a  map  from  1°°'*  to  we 

can  generate  a  time  varying  operator  A  as  (Ay){t)  -  (Aty)(t),  t  =  0, 1, . . .  . 
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Definition  6.2.2  The  operator  A  is  called  slowly  time-varying  if  there  is  a  constant 
7  >  0  so  that 

\\At  -  Ar\\  <  y\t  -  t\  'it,T. 

This  is  denoted  by  At  €  STV{y). 

If  At  €  Cti  for  all  t  and  also  the  Cti  norm  is  bounded  uniformly  in  t  then  A  €  Ctv  nnd 
normA  =  sup^  ||Pt‘i4t||. 

5.3  Problem  Definition 


The  problem  we  want  to  analyze  is  the  stability  and  performance  of  the  feedback  system 
in  Figure  5.1  where  P  is  a  slowly  varying  plant  and  C  is  a  controller  obtained  by  “frozen¬ 
time”  control.  Specifically,  the  plant  P  is  defined  as  P  =  A~^B  where  A,B  are  slowly 
varying  operators  associated  with  the  sequences  {Pt}»  t  =  0, 1, 2, ...  of  LTI  stable 

operators  respectively  and  with  v4~*  being  well  defined.  Hence,  the  plant  model  is 


y(t)  =  (Pu)(f)  ~  (A  ^Bu)(t),  t  =  0,1,2,... 

or,  equivalently, 

(At!/)(f)  =  (Btu)(0,  f-0.1,2 . 

We  refer  to  the  LTI  system  Pt  =  Af  ’  Bt  as  the  “frozen-time”  plant.  The  controller  is  given 
as  C  =  L~^M  where  L,  M  are  associated  with  the  sequences  {L(},  {Mf},  t  =  0, 1, 2, ...  of 
LTI  stable  operators  i.e.,  {Ly){t)  =  [Lty)(t)  and  (My){t)  —  (Mty){f).  Moreover,  Lt,Mt 
are  so  that  the  LTI  controller  defined  as  Ct  —  Lf^  Mi  stabilizes  the  frozen  time  plant  Pt. 
The  controller  operates  as 

{Cy){t)  =  (L-Hly)(t),  t  =  0,1,2,... 


or,  equivalently, 

{Ltu){t)  =  (M,y)(t),  1  0,1,2,...  . 

The  question  we  want  to  answer  is  under  what  conditions  the  feedback  loop  is  stable 
and,  if  so,  what  is  the  relation  between  the  performance  of  the  frozen-time  pair  (Pt,Ct) 
and  the  actual  time  varying  feedback  pair  {P,C).  This  is  done  in  the  following  section. 
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Figure  5.1:  Feedback  Loop  of  the  Pair  {P,  C) 


5.4  Main  Result 

In  [6]  an  input-output  point  of  view  was  taken  to  prove  that,  under  the  assumption 
of  sufficiently  small  rate  of  variation,  stability  of  the  frozen-time  feedback  paiir  (Pt,Ct) 
implies  stability  of  the  pair  (P,  C).  Yet,  the  performance  part  of  the  problem  was  not 
investigated.  In  the  sequel  we  take  the  same  point  of  view  as  in  [6]  and  extend  the  results 
in  [6]  to  capture  the  performance  issue.  In  particular,  for  the  system  in  Figure  5.1  define 
the  stable  LTI  operator  for  each  t  —  0. 1, 2, . . . 

(./  =  -h  AtfPf. 

Since  Ct  stabilizes  Pi  then  Hi  —  f-  Cri-  Now  let  5'^  represent  the  map  from  uj  to 
yi  in  the  system  of  Figure  5.1  and  .9,'^  the  (LTI)  map  from  uj  to  for  the  frozen  system 
(PtfCt).  The  foUowing  theorem  which  is  an  extension  of  Theorem  1  in  [6]  supplies  the 
answer  to  our  problem. 

Theorem  6.4.1  Assume  the  following: 
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1.  The  operators  defining  the  plant  P  are  slowly  time-varying  with  rates  i’-Pm 

^tGSTV(7A),^t6STV(7fl). 

2.  The  operators  defining  the  controller  C  are  slowly  time-varying  with  rates 
i.e.,  Lt  6  STV(7i),Mt  6  5TV(7m). 

3.  The  Cti  norms  and  the  ITAE  of  the  operators  At,  Bt,  Lt,  Mt  are  uniformly  bounded 
in  t;  this  of  course  means  that  A,  B,L,  M,  €  Cyv 

4.  The  Cti  norms  and  the  ITAE  of  the  operator  Ht  =  are  uniformly  bounded  in 
t. 

Then,  for  a  given  (  >  0,  there  exists  a  nonzero  constant  7  so  that,  if  74, 75,  7l, Km  <  7» 
the  closed  loop  system  is  internally  stable  and 

(l-€)||5‘-»l|<sup||5;-'||  +  e. 

t 

Proof.  The  proof  of  the  stability  part  is  given  in  [6].  Here  we  repeat  in  brief  the  main 
steps  because  we  will  use  them  to  prove  the  claim  for  the  performance.  The  closed  loop 
equations  for  the  system  in  Figure  5.1  are  as  follows: 


{Lty2){t)  -  f  y])){t) 


AtLt  I  A// Zlf  —  G'( 


By  adding  subtracting  and  groui)ing  terms  we  finally  arrive  [6]  at 

/G  +  A'  Y  \(yi\  (LB  -BM\(ut\ 
\  -Z  G-^WjKy^J  \MB  AM  )\U2 1 


(CL) 


where  G  is  the  operator  in  Ctv  associated  with  the  family  {G(}  and  X,Y,Z,W  are 
“perturbation”  operators  which  are  due  to  the  time  variation  of  the  system  P.  As 
indicated  in  lemmas  1  and  2  in  [6]  those  operators  have  Ctv  norm  bounded  by  the  term 
7Xconstant  where  7  =  max(74,7B,7/:„7,H)  and  the  constant  depends  on  the  uniform 
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bounds  of  assumption  3  of  the  Theorem  5.4.1;  i.e.,  there  are  consteints  cx,cy,  cz,  >  0 
so  that 

llJfll  <  7^^-,  <  7«ri  ll^ll  <  7CZ,  ||W||  <  7ctv 

Now,  from  the  first  equation  in  (CL)  we  have 

Gy\  +  Jfyi  +  Y  y2  =  v 

where  v  —  LBui  —  BMu2-  If  we  fix  some  t,  Gt  is  a  LTI  operator;  adding  and  subtracting 
this  operator  in  the  above  operator  equation  we  obtain 

Gtyi  +  {G  —  Gt)y\  Xy\  Yy2  ~  V 

or  since  Ht  =  G^^  we  obtain 

j/i  +  Ht{G  —  Gt)yi  +  HtXy\  +  HfYyi  =  Htv. 

Evaluating  this  operator  equation  at  time  f  we  obtain 

yi(t)  +  {Ht{G  -  G,)yiKf)  +  (ff,Xy,)(0  +  (HtYy2){t)  =  (Htv)(t). 

Define  the  operator  H  as  (Hz){t)  —  (Hrz)(T),  r  =  0, 1,2, . . ..  Also  define  the  operator 
R  as  (IZyi)(r)  =  {Hr{G  -  6V)yi)(r'),  r  =  0,1,2,....  Rewritting  the  above  equation  in 
operator  form  we  have 

yi  +  Ryi  +  HXiji  +  HYy2  =  Hv. 


Similarly  working  with  the  second  equation,  lotting  tr  =  MBui  +  AMu2  and  putting 
both  equations  together  in  operator  form  we  get 


{I  +  F) 


where 


/  n  I  //A  BY  \ 

\  BZ  R^BW)' 


Note  that  from  the  uniform  Imund  assumption  <mi  Br  it  follows  that  H  €  .Cjv  and 
therefore  the  norms  of  the  operators  B X.  B Z.  BY,  B\V  ran  be  bounded  by  7 x constant. 
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Also,  utilizing  the  fact  that  the  ITAE  of  Hr  is  uniformly  bounded  it  is  shown  in  [6]  that 
the  norm  of  R  is  bounded  in  the  same  way  i.e.,  <  7  x constant.  The  stability  of  the 

loop  then,  follows  from  the  small  gain  theorem  for  sufficiently  small  7. 

We  now  come  to  the  performance  part.  We  will  prove  our  claim  for  the  maps  5^*,  5**; 
the  proof  for  any  other  map  is  completely  analogous.  Let  =  0  and  let  ||u2||  <  1.  Then 
from  the  system  equations  we  get 

yiit)  =  -{HtBMu2)it)  -  {Hayi)it)  -  {HtYy2)it)  -  {Ht(G  -  GM(t) 

Consider  now  the  frozen  LTI  feedback  system  at  time  t  i.e.,  {Pt,Ct)  subjected  to  the 
same  input  uj  and  let  yn  denote  the  output  that  corresponds  to  yi  in  the  time  varying 
loop  (P,  C).  Then  evaluating  y^  at  t  we  have 


yu(f)  = 

Subtracting  the  above  two  equations  we  obtain 

yit(0  -  vAt)  =  {Ht(BM  -  BtMt)u2){t)  +  {HtXyx)(t)  +  (HtYy2){t)  +  {Ht{G  -  GM(t). 

The  idea  here  is  to  bound  \{Ht{BM  -  BtMt)u2){t)\  by  7Xconstant.  For  this  purpose 
define  the  operator  K  6  Ctv  as 

(A'2)(r)  ^  t  =  0,1,2,... 


then 


{HtiBM  -  BtMt)u2)(t)  =  {Ht{BM  -  K)u2)(t)  +  -  .BtMtjujKf). 

By  lemma  1  in  [6]  and  the  fact  that  Ht  has  norm  uniformly  bounded  it  follows  that 

\{H,{BM  -  A)w2)(0I  <  icr 

with  Cl  a  positive  constant.  For  the  term  {Hi{K  -  )t/2)(f )  we  have  the  following: 

\\BrMr~B,Mf\\  <  ||B,||||AA  -  AAII  +  IIALIIIIB, -B.ll 

<  \\fK\\lM\i  r!  V  PLlhslf  -  rj 
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<  7C2|e  -  r|. 


Hence,  if  z(t)  =  {{K  -  BtMt)ui){T)^  then  |z(t)|  <  '^Ci\t  -  r|,  t  =  0,1,2,...  with 
C2  >  0.  But  then  from  the  fact  that  Ht  haa  bounded  (uniformly  in  t)  ITA£  it  follows  as 
in  theorem  1  of  [6]  that 

\{Ht{K  -  BtMt)u2)(t)\  =  \^'£h,{t  -T)z{T)\ 

T=0 

<  7^2  £  |/it(r)|r 

T=0 

<  7C3,  C3  >  0. 

Now,  looking  at  the  rest  of  the  terms  and  since  ||u2|[  <  1  we  have  |(/ftA’yi)(t)|  < 
7C4||512||,  \(HtYy2){t)\  <  7C6||522||  ^nd  \(Ht{G  -  (;t)yi)(t)|  <  lce\\S^^  so  putting  ev¬ 
erything  together  it  follows  that  there  are  c,Ci2,C22  >  0  so  that 

|yi(0  -  yit(<)l  <  7c  +  7Ci2||5^^||  -I-  7C22||5“|| 

or  since  ||u2||  <  1  then  |yit(<)|  <  ||5/^||  and  therefore 

sup  |yi(0l  <  sup  ||5/*||  -f  7c  -f-  7Ci2||5”||  -I-  7C22||5”|| 

t  t 

and  since  U2  is  arbitrary 

||5i2||  <  sup  ||5/2||  +  7<-  +  7Ci2||5»‘||  -|-  7C22||5”||. 

t 

Similarly  working  for  (|5^^||  we  get 

||5”||  <  sup  115^11  f  -yk  +  7*-22||5”||  -f-  7l;,2||5”||. 

t 

Now  noting  that  ||Hf||  is  uniformly  bounded  then  sup^  ||.Sj^^||, sup,  ||5,*^||  <  00  and  hence 
by  assumming  7  sufficiently  small  the  proof  of  the  theorem  is  complete.  ■ 

The  above  theorem,  roughly  speaking,  indicates  that  if  the  rates  of  variation  of  the 
plant  and  the  controller  are  sufficiently  small  then  frozen  time  control  would  not  only 
provide  stability  but  also  the  residting  performance  cannot  be  much  worse  than  the 

T.l 


worst  frozen  time  design.  In  [7]  it  was  shown  under  certain  assumptions  of  existence  and 
uniqueness  that  the  design  methodology  produces  optimal  frozen-time  LTI  controllers 
for  the  frozen-time  plant  that  possess  the  slow  variation  property  given  that  the  plant 
is  slowly  varying.  Hence  an  upper  boimd  on  the  achievable  ||5*-’||  can  be  obtained  by 
considering  fi-optimal  (10, 11]  frozen  time  control  i.e.,  by  considering  sup^  ||5J^||  obtained 
by  li  optimal  designs. 


Remark 

A  natural  question  that  arises  in  the  case  where  the  plant  P  is  slowly  time  varying  is 
whether  optimal  frozen- time  design  at  each  time  t  will  result  in  an  optimal  or  near- 
optimal  design  (depending  on  the  rate  of  variation)  for  the  time- varying  system.  Al¬ 
though  it  is  tempting  to  conjecture  that,  if  the  rate  of  variation  is  sufficiently  small  then 
the  optimal  performance  cannot  be  far  from  the  performance  provided  by  optimal  frozen- 
time  control  at  each  time  t,  the  following  example  shows  that  this  might  not  be  true: 
Consider  the  plant  P  6  Ctv  defined  by  the  sequences  {At},{Bt}  where  Ae{A)  =  1  Vt, 
Bt{X)  =  2A  -i-  1  for  t  =  0,1  and  H,(A)  =  2A  -I-  (1  +  yf)  for  2  <  t  <  T  =  [l/y  -|-  1], 
flt(A)  =  2A  -I-  (1  -t-  yT)  for  t  >  T,  with  y  >  0.  The  resulting  Toeplitz  representation  of  P 


2  1  f  y 

2  1  i  2y 

2  1  -(-  Ty 

2  1  +ry 


Clearly,  for  this  P  we  have  \\Bt  -  Bt\\  S  y|/  t|  V^,  r.  Suppose  we  are  interested  in 
minimizing  the  Cjv  norm  of  the  sensitivity  map  .9  =  (1  +  PC)~^.  Then  as  it  is  well 
known  [19,  57,  61]  the  optimization  problem  transforms  to 


inf  111  -  PQ\\. 
Qk  Ltv 
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For  this  particiilar  P  we  have  that  P  ^  €  Ctv  since  Pt  =  Bt  is  eventually  (t  >  T)  stably 
invertible.  To  view  this,  let  P~'  be  represented  by  the  lower  diagonal  structure 

/9(0,0)  0 

p-i  =  j  g(i,o)  9(1,1)  ... 

Then  the  following  recursion  holds: 

9(i»i)=  -29(t,»)9(»-  »  >  0,  j  =  0,1, ...,i-  1 

with  9(0, 0)  =  1,  9(t,  t)  =  1/(1  +  (t  -  1)7)  for  i  =  1, . .  .,T  and  9(1,  t)  =  1/(1  Ty)  for 

i  >  T.  Note  that  for  i  >  T  we  have  that  |9(t,  t)|  ~  |9(T,  T)|  <  1.  Therefore,  for  any 

A:  1, 2, ...  we  have 

r+fc 

E  +  k,j)\  <  (maxo<,<r-t  MT  -  l,i)|)|9(P,T)l''  +  EU 

<  Ci\q{T,T)\+ 

This  evidently  shows  that  P~^  6  Ctv-  Hence,  by  choosing  Qo  =  P~^  we  can  make 
||1  -  PQo\\  =  0  for  any  7.  On  the  other  hand,  using  tj  optimal  frozen  time  design 
yields  [10,  11]  St=o  -  l,5f=i  -  l,...,5t=7’  =  0, 5t=r+i  =  0, —  The  reason  for 
St-Oi  -  •  •St=T-\  7^  0  is  of  course  the  unstable  zero  of  Pt=0i‘  •  -  yPt-T  at  ^  =  (1  +  t7)/2 
for  all  7.  Moreover,  the  resulting  frozen  time  based  controller  will  yield  a  performance 
||5||  >  1  for  any  7  >  0  no  matter  how  small,  since  the  system  will  behave  exactly  as  the 
frozen  LTI  one  for  t  =  0, 1. 

5.5  Application  to  Robust  Adaptive  Control 

In  this  section  we  utilize  the  main  result  of  the  previous  section  in  order  to  design  a  con¬ 
troller  for  a  LTI  system  which  contains  both  parametric  (structured)  and  unstructured 
uncertainty. 

5.5.1  P  '’em  statement 

The  problem  we  want  to  resolve  is  as  follows: 

We  are  given  the  single-input,  single  output  discrete  system 

((/lo  f  A4)(/)(/)  -  ((P„  4  AB)w)(t)  +  (/(O 
7ri 


where  Ao<,Bo  are  operators  in  Cti  with  a  polynomial  A-transforni  representation 

=  1  +  1)A+  a„{2)\^  +  .. .  +  a(j(mi  )A”*' , 

5o(A)  =  6„(1)A  +  M2)A^  +  . . .  +  6„(m2)A’”% 

with  the  coefficients  of  i4<,(A)  and  not  known  a  priori;  Aa  and  Ab  are  unknown, 

possibly  time-varying,  operators  in  Ctv  »•«•»  llAyiH,  1|Ab||  <  oo;  finally,  d  is  a  bounded 
disturbance  i.e.,  |d(t)|  <  /),  Vt  =  0, 1, 2, . . .  for  some  D  >  0.  We  assume  the  following  a 
priori  knowledge 

Assumption  5.6.1  The  integer  n  =  max(mi,m2)  is  known. 

Assumption  6.6.2  The  coefficients  of  i4o(A),  Bo(^)  he  in  a  compact  convex  set  0  which 
is  known.  Moreover,  the  above  polynomials  are  coprime  (no  common  zeros)  for  all 
possible  values  of  their  coefficients. 

Assumption  6.6.3  The  bound  D  and  some  bound  so  that  ||(Ab  Ayj)||  <  are 
known. 

Our  task  is  to  find  a  controller  C  that  stabilizes  the  system  in  the  presence  of  the  bounded 
disturbance  d.  The  situation  is  depicted  in  Figure  5.2  where  Bo  =  A~^Bo. 

5.5.2  An  Indirect  Control  Scheme 

The  system  equations  can  be  rewritten  as 

y(<)  =  d{t)  +  ((  Ab  A4)  (  ")  )(0 

where 

^o  =  (  "o(n)  />„(])..  .5o(n))^ 

<f)(t  -  1)^  ^  (y(f  -  -  n)  u(f  -  l)...w(t  -  n)). 

The  approach  we  will  use  to  design  the  controller  is  an  indirect  adaptive  scheme 
[30]  which  is  a  generalization  of  the  one  in  [7]  to  include  unstrtictured  unrertainty.  In 
particular,  we  will  use  a  parameter  estimation  scheme  to  su])ply  at  each  time  t  estimates 


$1  for  Bo-  The  controller  C  will  be  designed  based  on  frozen  designs  C-t  so  that  C't  stabilizes 
the  estimated  system  at  time  t\  the  properties  of  slow  variation  of  the  estimates  produced 
by  the  parameter  estimation  scheme  together  with  the  main  result  of  the  previous  section 
will  guarantee  stability. 

More  specifically,  let  rf(t)  =  ((Ajj  Aj*)  equation  for  the  model  is 

with  |^(t)|  <  D^(t)  and  |d(t)(  <  jD,  Vt  =  0, 1, 2, . . .  where 

max(|u(r)|,|y(r)|). 

0<T<t 

The  parameter  estimation  scheme  to  be  used  is  a  robustified  least  squares  algorithm 
with  dead-zone  found  in  [42]  which  is  a  modification  of  the  one  in  [29].  Define  for  each 
estimate  Bt  the  error  signal 

e(<)  =  y{t)  - 


then  the  algorithm  is  as  follows 


B  =  B  -t- 

‘  1  -f-  -  1  fP[t  -  2)<i>(t  -  1) 


P{t  -  1)  =  P{t  -  2)- 


v(t)P{t -2)4>{t-\)4>{t  -\)T'P{t-2) 


'  I  +  -  1) 

where  Bq  and  /’(  —  I)  are  initial  guesses  with  P(  -1)  =  F{  — 1)^  >  0,  and  where  v[t)  = 
as{t)  with 

s(0-  fWD'{f)+  Dhr{t))/e{t), 

where  we  choose  a  €  (0, 1),  /?  is  defined  by  /I  -  \/l/(  1  ~  ‘^nd  /(-,•)  is  the  dead-zone 


function 


f  lj/l  kl,  if  [■'•I  <  |y| 

1  0.  otherwise 


The  full  set  of  details  of  the  algorithm  ran  be  found  in  [42],  The  ])roperties  of  the 
algorithm  that  will  be  used  for  stability  of  the  adaptive  scheme  are 
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1. 


2. 


p{^(D\t)  +  D)Mm 

t-oo  1  +  -  1)P(<  -  2)<i>(t  -  1) 


lim  \0t  -  0f_i|2  =  0 

t—*oo 

3. 


P(t)  >  0,  a(P(0]  <  5'lP(-l)l  <  oo,  Vt 


We  should  note  that  constraining  the  estimates  dt  to  he  in  0  as  in  [30]  does  not  change 
properties  1,2,3  of  the  algorithm.  The  parameter  (3  in  the  estimation  scheme  will  be 
taken  close  to  1  i.e.,  1  <  <  1  +  ij,  where  t]  is  sufficiently  small  (to  be  established  in 

the  sequel)  and  positive.  The  following  generalized  “key  technical  lemma”  [7,  30]  gives 
conditions  for  stability  of  the  adaptive  scheme. 

Lemma  5.5.1  Assume  the  following 

1.  there  are  constants  ci  >  0,C2  >  0  and  some  time  instant  Ti  so  that  for  all  t  >  Ti 

|^(0l2  <  Cl  +  C2  inax  |e(t)|, 

T 1  <  r  <rf 

2. 

lim  W(^M0  +  L>),k(0l)  _ 

1 +  _  1)P(,  _  1) 

3.  there  are  constants  fci  >  0, 1:2  >  0  with  h  <  ^  and  some  time  T2  so  that  for  all 
t  >  T2 

<  1*1  +  1:2  max  |e(r)|. 

rj<r<< 

Then  the  sequence  {e(t)}  is  bounded  and,  therefore,  {u(t)}  are  bounded. 

Proof.  Assume  {e(t)}  is  unbounded  and  let  the  subsequence  {e(t„ )}  be  so  that  lim„_oo  |t(t„)| 
00  with  |e(to)|  <  |e(ti)|  <  —  Then  there  is  some  hq  so  that  Vri  >  no 


D^(tr,)<  h  f  l-2|r(t,.)| 
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But  then  if 


|^(<n)|2  <  Cl  +  C2|e(t„)| 

+  JO),e(t„))  =  |e(t„)|  -  ^{D\tn)  +  D)  >  0. 


we  have 


therefore 


1  +  -!)/*( t„-2)^(t„-l) 

,  (|e(tn)|-/?(2^M<n)  +  i?))^ 
n-|<^(t„-i)|ia^[P(-i)] 


limsupon  > 

n— »oo 


4W[P(-1)] 


>  0 


which  contradicts  assumption  2. 


The  above  lemma  guarantees  boundedness  of  the  signals  provided  that  the  three  as¬ 
sumptions  hold.  Hence,  if  the  control  signal  u  is  such  that  the  assumptions  of  Lemma 
5.5.1  are  satisfied,  then  the  above  weak  form  of  stability  [7]  of  the  system  is  obtained. 

In  the  sequel  we  show  that  under  certain  conditions,  using  frozen  time  control  for  the 
estimated  system  at  each  time  t  generates  a  control  sequence  u  that  satisfies  the  assump¬ 
tions  of  Lemma  5.5.1  and  hence  weak-stability  is  guaranteed.  This  is  done  as  follows: 
Rewriting  the  equation  for  the  error  e  we  obtain 

(i4t_,y)(/)  (H,-  ,u)(f)  -f-  €(t) 

where  i4t_i,  G  are  defined  by  the  estimate  0t_i  =  (-af_i(l) . .  .-at_i(n)  6(_i(l) . . . 
as 

j4(_i(A)  —  1  -I-  af_j{l)A  a^_i(2)A^  -|-  . . .  -f  a(_i(n)A”, 

Ht_i(A)  =  6t_i(l)A  -I-  6,_,(2)A*  +  . . .  +  6e_i(n)A". 

Therefore,  u  and  y  can  be  considered  as  the  input  and  output  of  a  “fictitious”  time- 
varying  system  defined  above  (Figure  .5. .3)  subjected  to  the  disturbance  e.  Suppose 
now  that  the  controller  C  provides  stability  for  the  fictitious  system  and  also  has  the 
property  ||5“'((,  ||5’''||  <  -t-q))  where  5“'^  and  are  the  maps  from  c  to  u  and 

y  respectively  and  q  >  0  with  I  /3  ^  I  1  q.  Then,  the  assumptions  of  Lemma  .5.5.1  are 

^10 


Figure  5.3:  The  “Fictitious”  Feedback  Loop 

satisfied:  the  validity  of  assumption  1  follows  from  the  stability  of  the  fictitious  system, 
assumption  2  is  satisfied  from  the  properties  of  the  parameter  estimation  algorithm  and, 
finally,  assumption  3  is  fulfilled  since 

D^{t)  =  max  (|w(r)(,(y(r)|)  <  Z?a  max(((5“*’(|,  ||5'''||)  max  (e(r)( 

o<T<f 

or 

/?'(#)  <  k2  max  |c(r)|,  k2  =  1/(1  +  r/)  <  l/j3. 

0<T<f 

In  fact,  we  can  relax  the  norm  requirements  ||5"'’||,  ||5*'‘’||  <  1/(Da(1  +  »?))  on  the  maps 
by  imposing  the  same  condition  for  a  delayed  version  of  the  fictitious  system. 
To  view  this,  suppose  the  controller  is  defined  by  LTI  stable  operators  as 

(L,n)(t)  =  (Mfy){t)  +  r{t) 

where  Lf(A),  Mt(A)  are  coprime  polynomials  of  degree  at  most  N  for  all  t.  Without  loss 
of  generality  we  can  take  N  >  n.  Let  A  be  the  right  shift  operator  and  assmne  that 
there  is  a  time  index  T  so  that  the  delayed  maps  A“^5^''A^,  S'^’' ST , 
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\-Tsvr\T  are  in  Ctv  i-e-,  if  the  inputs  c,  r  G  foo  are  delayed  by  T  then  the  resulting 
y,u  are  in  <oo-  Moreover,  let 

||A-r5“*Ar||,||A-r5‘^Ar||  <  1/(Z)a(1  +  t,)). 

Defining  the  state  vector 

®(t)  =  (y(t  -  N)  u{t  -  N)  y{t  -  N  +  l)  u{t  -  N  +  l)  ...  y(t  -  1)  u(t  -  1))^ 

we  obtain  the  state  space  description 

/  0  /  0  ...  0 

00/...  0 
*(<  +  !)=  •  :  0 
0  0  ...  0  I 

$2(t)  •••  ^jv(t) 

where  #,(<)  are  2x2  matrices  obtained  from  the  coefficients  of  At(A),  5t(A),  Lt{A),  Mt(A) 
and  w{t)  =  (e(t)  r(t))^.  Clearly,  this  is  a  completely  reachable  state  space  represen¬ 
tation  of  the  closed  loop.  Therefore,  we  can  ensure  that  the  initial  input  {e(t)}^o 
does  not  produce  unbounded  u  and/or  y  for,  otherwise,  it  contradicts  the  stability  of 
the  delayed  system:  any  state  at  T  4  is  reachable  by  some  tr  G  foo  of  the  form 
w  =  {0, . . . ,  0,  w{T),  w{T  4-  1), ... ,  w{T  4  N),  0, . . .}  and  a  zero  state  at  T;  hence  the  ini¬ 
tial  input  {e(f)}^o  cannot  drive  the  system  to  a  state  Fit  T  +  N  that  results  to  imbounded 
>  T  because  then  a  bounded  w  as  above  applied  to  the  delayed  system  would  yield 
an  unbounded  y  and  u  which  is  a  contradiction.  But  then  we  can  pick  some  nonzero  Ci,  Jbi 
to  account  for  the  initial  input  and  have  the  conditions  of  Lenmia  5.5.1  sat¬ 

isfied  for  T\  =  T2  =  T.  This  in  turn  will  guarantee  weak  stability  of  the  adaptive  scheme. 

5.5.3  A  Class  of  Stabilizing  Controllers 

Property  2  of  the  estimation  algorithm  shows  that  the  parameter  estimates  will  eventu¬ 
ally  vary  arbitrarily  slowly;  hence  since  ||.4f  -  Af_i||  <  \9t  -  and 

\\Bt  -  5t_i||  <  \9t  -  9t-\\2  it  follows  that  eventually  Af^Bi  G  STV{^)  for  some  7  >  0 
arbitrarily  small.  Utilizing  now  the  results  of  Theorem  5.4.1  and  Lemma  5.5.1  we  are 


able  to  characterize  a  class  of  stabilizing  controllers  for  the  original  system  of  Figure  5.2. 
This  is  done  in  the  following  theorem. 

Theorem  6.6.1  Assume  that  for  each  t  the  frozen  time  controller  Ct  =  sta¬ 

bilizes  the  frozen  time  LTI  system  given  by  At-\y  =  Bt-\u  +  e.  Also  let  the  following 
be  true 

1.  There  are  constants  cm,  cl  >  Q  so  that 

\\Mt  -  Mt^tW  ^  ||^<  -  <  CL\6t  - 

2.  The  degrees  of  it(A),  Mf(A)  as  well  as  the  ITAE  of  Mt,  Lt  are  uniformly  bounded 
in  t. 

3.  The  Cti  norm  and  the  ITAE  of  Hf  =  {LtAt  +  are  uniformly  bounded  in 

t. 


4.  There  is  a  e  >  0  and  a  time  index  To  >  0  so  that 


—  € 


Da(1  +  T}) 


—  € 


where 

Then  the  control  law  u{t)  -  {Cy){t)  where  {Lt-iu)(t)  -  {Mt-iy)(t),  t  =  0, 1, . . .  yields 
a  weakly  stable  adaptive  system. 

Proof.  The  proof  of  the  theorem  follow.s  the  same  steps  as  Theorem  5.4.1.  First,  since 
the  estimates  should  lie  in  the  compact  set  0  and  i'lf  ( A),  Bt(X)  have  degree  n  then  At,  Bf 
have  uniformly  bounded  norms  and  ITAE  [7].  Also,  from  assumption  1  the  Cti  norms 
of  Mt,Lt  will  be  uniformly  botmded.  Note  that  S',”’  --  M,_\Ht^],  =  Lt-.iHt-\  are 

precisely  the  maps  from  e  to  xi  and  from  cloy  respectively  in  the  frozen  LTI  system. 
Since  the  rate  of  variation  of  the  estimates  converges  to  zero  then  there  exists  some  time 
index  T  >  To  after  which  the  rate  of  variation  is  sufficiently  small  to  guarantee  stability 
of  the  delayed  fictitious  system  and,  moreover,  the  delayed  performance  conditions 


and 


(l-e)||A-^5v«Ar||<sup|15ri|+6. 

t>T 

The  above  assertion  can  be  proved  exactly  as  in  Theorem  5.4.1.  But  then 

||A-r5v*A^’||  <  1/(Z)a(1  +  V)h  ||A-^5“Ar||  <  l/(i?A(l  +  »/)) 

and  hence  by  the  key  techniceil  Lemma  5.5.1  the  proof  is  complete.  I 

Note  that  the  requirements  on  the  frozen-time  LTI  maps  5“'  =  = 

Lt-iHt-i  are  exactly  the  stability-robustness  requirements  in  the  presence  of  the  co¬ 
prime  factor  perturbations  A^,  of  “ahnost”  the  same  magnitude  (for  small  enough 
q,c)  in  the  estimated  LTI  system.  Hence  the  meaning  of  the  above  theorem  is  the 
following:  Given  a  design  methodology  that  produces  controllers  Ct  which  are  Lipschitz- 
continuous  with  respect  to  the  parameter  estimate  0t,  then  stability  of  the  frozen-time 
feedback  loop  of  (Af_i  +  Ayi)~*(B£_i  +  Ab)  and  Ct  will  result  to  weak  stability  of  the 
adaptive  scheme.  Next,  we  present  an  indirect  adaptive  scheme  which  produces  frozen¬ 
time  controUers  that  possess  the  required  continuity  properties. 


5.5.4  The  £i  Adaptive  Algorithm 


Here  we  present  briefly  a  generalization  of  the  adaptive  scheme  of  [7]  and  give  sufficient 
conditions  for  stability.  The  scheme  utilizes  frozen-time  controllers  Ct+i  =  L^^Mt  at 
each  t  -f-  1  that  stabilize  P(  =  Af  ’  Bi  and  minimize  the  following  criterion 


inf  I 

C|4i  stabilizing 


inf  I 

C(4]  stabilizing 


/c,+,Ar'(i  + 


Employing  the  parameterization  of  all  stabilizing  controllers  [28]  for  Pt  we  transform  the 
problem  to 

where  Xt,  Yt  are  polynomials  in  Cti  satisfying  the  Bezout  identity 


X,A,  -  YtBt  r-  1. 
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All  stabilizing  controllers  are  obtained  as 


Yt  +  AtQt 


Xt  +  BtQt 

Sij‘'':e  At,  Bt  are  coprinie  then  the  only  restriction  on  Kt  =  ^  ^  Qt  is 

{-Bt  At)Kt  =  0 

(5“*  \ 

j  is 

{-Bt  At)$t  =  l. 

As  indicated  in  [5]  the  problem  can  be  transformed  to  a  semiinfinite  linear  programming 
problem  using  duedity.  The  solution  to  the  latter  can  then  be  computed  with  arbitrary 
accuracy  by  truncating  the  constraints  or  the  variables.  In  particular,  the  resulting 
problem  is  as  follows  [5] 


fi{dt)  =  sup  *(0) 


subject  to 


/-MO) 

...  -Mn) 

0 

0  ...\ 

0 

-MO)  -Ml)  ••• 

-b,{n) 

0  ... 

at(0) 

at(l) 

o,(n) 

0 

0  ... 

0 

at(0)  0,(1) 

a,(n) 

0  ... 

^From  the  above  formulation  continuity  of  the  cost  ^l{0t)  with  respect  to  parameters 
changes  i.e.,  Ot  is  easy  to  be  established.  This  does  not  automatically  imply  that  the 
assumptions  1,  2,  3  of  Theorem  5.5.1  are  satisfied.  What  we  need  is  to  be  continuous 
with  respect  to  9t  s^nd  also  to  have  a  uniform  degree  bound.  These  requirements  might  not 
be  satisfied  in  this  complete  generality;  for  example  when  the  solution  is  not  unique  then 
continuity  is  immediately  destroyed.  Hence,  additional  assumptions  might  be  needed.  In 
the  case  however,  where  Ab  -  0  this  is  not  needed.  In  this  case,  the  problem  becomes 


inf  + 

C14.1  stabilizing 


85 


As  shown  in  [7]  the  finite  dimensionality  of  the  LTI  system  Pt,  the  compactness  of  0 
together  with  the  properties  of  the  optimal  l\  solution  serve  to  satisfy  assmuptions  1,2,3 
of  Theorem  5.5.1.  For  assumption  4  to  hold  the  following  condition  suffices: 

3c>  0  : =^sup/t4(0)  <  — ^  -  c  (C). 

se©  ^a(l  +  V) 

Note  that  <  oo  since  Pg  is  finite  dimensional  and  0  is  compact.  Conversely,  from 
the  above  condition  we  can  evaluate  the  bound  Di^  of  ||Ax||  for  which  the  l\  indirect 
adaptive  scheme  guarantees  stability.  Namely, 


Da  < 


This  is  so  because  then  there  are  e, »?  >  0  so  that  condition  (C)  holds.  We  should 
emphasize  that,  pertaining  to  this  particular  class  of  indirect  adaptive  controllers,  the 
/i  adaptive  scheme  provides  the  greatest  upper  bound  on  the  size  of  ||Ay|||  namely  1/ ha 
for  which  stability  is  guaranteed.  We  do  not  however  claim  that  this  adaptive  scheme 
is  the  optimal  one.  Also  note  that  even  if  As  =  0  the  plant  model  captures  a  wide 
class  of  uncertain  systems.  Finally,  we  should  stress  that  in  the  case  where  Ab  #  0 
if  the  continuity  assumptions  are  satisfied  then  a  bound  on  for  which  stability  is 
guaranteed  is 

Da  <  - 737  • 

S«I>«60  fiW 


5.6  Conclusions 


In  this  chapter  we  presented  a  to  performance  result  in  the  case  of  slowly  time 
varying  systems.  We  showed  that  the  performance  of  a  slowly  varying  system  cannot 
be  much  worse  than  that  of  the  frozen  time  systems.  Our  approach  was  an  input- 
output  approach  established  in  [6).  We  utilized  this  result  to  characterize  a  class  of 
adaptive  indirect  controllers  t  hat  stabilize  a  time  invariant  system  which  is  subjected  to 
both  parametric  and  unstructured  uncertainty.  Also,  among  a  class  of  indirect  adaptive 
controllers,  we  proposed  an  indirect  adaptive  scheme  that  provides  the  greatest  upper 
bound  on  the  size  of  unstructured  uncertainty  for  which  stability  is  guaranteed. 
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